-- Logs begin at Sat 2022-06-25 20:01:15 UTC, end at Sat 2022-06-25 21:01:54 UTC. -- Jun 25 20:34:12.297330 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jun 25 20:34:12.307088 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 25 20:34:12 2022] *** Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: nodename: dv-osbrick-master-4-ceph Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: machine: x86_64 Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: clock source: unix Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: pcre jit disabled Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: detected number of CPU cores: 4 Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: current working directory: / Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: detected binary path: /usr/bin/uwsgi-core Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: your processes number limit is 47680 Jun 25 20:34:12.309107 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: your memory page size is 4096 bytes Jun 25 20:34:12.309714 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: detected max file descriptor number: 2048 Jun 25 20:34:12.309714 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: lock engine: pthread robust mutexes Jun 25 20:34:12.309714 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: thunder lock: enabled Jun 25 20:34:12.309714 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 25 20:34:12.309714 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 25 20:34:12.358257 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: Python main interpreter initialized at 0x5557d22fe9c0 Jun 25 20:34:12.358257 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: python threads support enabled Jun 25 20:34:12.358257 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: your server socket listen backlog is limited to 100 connections Jun 25 20:34:12.358257 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: your mercy for graceful operations on workers is 90 seconds Jun 25 20:34:12.358717 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: mapped 403077 bytes (393 KB) for 2 cores Jun 25 20:34:12.358717 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: *** Operational MODE: preforking *** Jun 25 20:34:12.358944 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: *** uWSGI is running in multiple interpreter mode *** Jun 25 20:34:12.358944 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: spawned uWSGI master process (pid: 93687) Jun 25 20:34:12.359146 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jun 25 20:34:12.359689 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: spawned uWSGI worker 1 (pid: 93694, cores: 1) Jun 25 20:34:12.362589 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: spawned uWSGI worker 2 (pid: 93695, cores: 1) Jun 25 20:34:12.362589 dv-osbrick-master-4-ceph devstack@keystone.service[93687]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 25 20:34:18.048874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:34:18.048874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: from cryptography.utils import int_from_bytes Jun 25 20:34:18.049721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:34:18.049721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: from cryptography.utils import int_from_bytes Jun 25 20:34:18.055096 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:34:18.055096 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: from cryptography.utils import int_from_bytes Jun 25 20:34:18.055668 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 20:34:18.055668 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: from cryptography.utils import int_from_bytes Jun 25 20:34:18.099487 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 20:34:18.099669 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 20:34:18.099827 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] command line args: [] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 20:34:18.100132 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 20:34:18.100264 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ================================================================================ {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 20:34:18.100553 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] admin_token = **** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.100775 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] config_dir = [] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.101003 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.101142 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] config_source = [] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.101350 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] debug = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.101564 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.101932 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.102094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.102364 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.102647 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.102866 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] list_limit = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.103048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] log_config_append = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.103229 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.103408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] log_dir = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.103588 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] log_file = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.103824 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.104060 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.104305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.104388 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 20:34:18.104557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 20:34:18.104647 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.104726 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.104814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] command line args: [] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 20:34:18.104879 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.105026 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 20:34:18.105167 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.105363 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ================================================================================ {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 20:34:18.105491 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.105635 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] admin_token = **** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.105747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.105878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] config_dir = [] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.105990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.106093 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.106093 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] config_source = [] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.106323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.106472 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] debug = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.106579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.106693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.106859 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.106963 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.107100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.107208 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.107310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.107459 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.107459 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.107661 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] list_limit = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.107789 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.107902 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] log_config_append = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] publish_errors = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108248 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108349 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] log_dir = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108451 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108529 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] log_file = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108640 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.108968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109037 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109111 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] standard_threads = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109212 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109286 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109353 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109429 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109506 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109576 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109761 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] use_journal = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] use_json = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.109994 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.110082 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] use_stderr = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.110159 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.110230 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] use_syslog = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.110386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.110547 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.110680 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.110802 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.110918 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.111334 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.111448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.111577 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.111808 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.111930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.112040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.112156 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.112156 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.112370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.112544 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.112666 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.112783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.112900 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] publish_errors = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.113009 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.113122 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.113231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.113339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.113446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.113565 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.113676 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.113790 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.113923 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.114049 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.114143 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] standard_threads = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.114248 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.114348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.114468 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.114597 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.114701 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.114795 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.114909 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.115007 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] use_journal = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.115118 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] use_json = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.115237 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.115346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] use_stderr = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.115455 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.115564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] use_syslog = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.115673 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.115783 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 20:34:18.115891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.116001 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.116110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.116226 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.116327 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.116441 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.116581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.116703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.116820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117000 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117112 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117220 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117334 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117671 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117780 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117890 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.117998 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.118099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.118206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.118325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.118455 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.118577 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.118694 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.118810 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.118928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.119049 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.119159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.119270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.119377 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.119492 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.119609 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.119735 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.119935 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.120047 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.120156 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.120264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.120373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.120490 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.120605 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.120721 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.120830 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.120937 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.121047 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.121163 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.121273 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.121411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.121527 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.121684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.121810 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.121922 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.122036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.122147 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.122255 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.122363 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.122573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.122687 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.122802 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.122911 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.123019 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.123128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.123247 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.123357 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.123465 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.123574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.123687 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.123803 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.123920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.124030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.124136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.124245 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.124353 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.124466 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.124591 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.124702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.124810 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.124918 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.125032 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.125141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.125258 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.125367 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.125475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.125591 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.125702 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.125842 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.125968 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.126078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.126187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.126296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.126406 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.126542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.126664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.126776 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.126883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.126992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.127100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.127321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.127451 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.127571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.127681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.127834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.127949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.128060 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.128178 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.128326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.128492 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.128645 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.128798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.128951 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.129103 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.129265 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.129427 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.129577 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.129728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.129887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.130051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.130220 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.130379 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.130559 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.130559 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.130857 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.131003 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.131174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.131337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.131491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.131645 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.131797 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.131960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.132113 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.132411 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.132576 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.132738 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.132890 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.133040 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.133200 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.133470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.133643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.133796 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.133946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.134098 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.134261 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.134431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.134585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.134737 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.134887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.135051 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.135051 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.135367 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.135551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.135731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.135906 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.136078 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.136362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.136529 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.136726 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.136893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.136893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.137232 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.137433 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.137611 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.137814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.137983 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.138169 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.138332 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] auth.external = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.138603 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.138771 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.138971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.139145 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.139317 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.139503 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.139684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.139866 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] auth.password = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.140068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.140255 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] auth.token = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.140433 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.140575 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.140893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.141017 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.141130 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.141241 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.141352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.141462 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.141580 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.141699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.141811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.141922 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.142034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.142144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.142255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.142374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] credential.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.142500 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.142654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.142807 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.142932 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.143353 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.143619 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.143735 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.143856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.143970 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.144082 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.144193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.144326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.144494 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.144697 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.144863 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.145022 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.145185 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.145326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.145462 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.145589 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.145739 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] auth.external = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.145898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.146048 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.146196 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.146355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.146682 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.146842 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.146957 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.147068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] auth.password = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.147180 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.147300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] auth.token = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.147421 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] federation.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.147534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.147645 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.147756 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.147867 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.147977 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.148097 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.148209 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.148321 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.148439 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.148557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.148557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.148557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.148877 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.148988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.149105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.149226 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.149340 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] credential.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.149461 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.149573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.149684 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.149794 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.149897 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.150006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.150125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.150237 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.150347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.150474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.150586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.150697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.150821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.150934 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.151044 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.151155 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.151265 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.151375 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.151495 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.151693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.151817 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.151817 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.152034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.152147 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.152266 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.152378 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.152490 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.152599 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.152709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.152823 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.153015 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.153425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.153541 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] federation.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.153652 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.153763 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.153874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.153994 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.154106 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.154217 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.154328 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.154479 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.154606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.154720 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.154831 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.154948 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.155059 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.155176 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.155296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.155407 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.155518 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.155629 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.155740 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.155850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.155968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.156085 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.156197 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.156307 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.156417 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.156527 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.156648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.156761 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.156872 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.156982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.157092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.157202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.157320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.157432 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.157543 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.157653 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.157764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.157883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.158002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.158115 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.158225 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.158335 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.158503 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.158681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.158887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.159029 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.159175 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.159289 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.159407 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.159519 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.159638 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.159751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.159863 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.159973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.160084 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.160195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.160318 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.160431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.160542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.160652 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.160764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.160875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.160994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.161107 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.161218 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.161329 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.161439 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.161550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.161669 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.161781 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.161892 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.162003 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.162114 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.162225 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.162343 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.162468 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.162591 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.162705 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.162815 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.162925 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.163044 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.163156 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.163270 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.163381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.163491 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.163602 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.163720 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.163833 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.163943 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.164055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.164165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.164165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.164165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.164480 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.164591 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.164694 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.164803 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.164914 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.165037 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.165152 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.165263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.165375 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.165485 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.165596 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.165761 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.165874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.165984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.166095 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.166206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.166324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.166479 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.166594 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.166704 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.166814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.166924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.167047 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.167161 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.167272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.167382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.167382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.167589 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.167714 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.167891 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.167891 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.168217 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.168217 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.168552 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.168552 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.168945 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.168945 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.169253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.169416 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.169578 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.169750 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.169914 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.170076 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.170230 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.170384 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.170570 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.170744 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.170902 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.171057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.171212 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.171365 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] resource.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.171517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.171681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.171834 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.171988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.172142 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.172292 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.172444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.172444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.172745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.172899 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.173049 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.173204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.173357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.173524 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.173678 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.173830 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.173984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.173984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.174294 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.174541 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] role.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.174697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.174850 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] role.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.175003 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.175158 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.175314 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.175314 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.175614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.175767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.175924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.176082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.176234 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.176396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.176551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.176707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.176858 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.177011 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.177218 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.177393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.177547 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.177701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.177855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.178009 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.178170 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.178441 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.178599 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.178758 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.178912 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.179064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.179215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.179383 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.179539 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.179692 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.179692 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.179983 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.180139 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.180304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.180459 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] resource.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.180612 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.180765 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.180921 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.181082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.181236 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.181387 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.181539 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.181695 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.181849 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.182010 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.182174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.182333 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.182497 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.182635 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.182778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.182953 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.183111 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.183269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.183424 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.183424 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.183710 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] role.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.183710 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] role.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.184014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.184014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.184014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.184014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.184570 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.184733 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.184888 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.185045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.185197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.185352 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] token.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.185507 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.185765 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.185949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.186104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.186258 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.186453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.186611 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.186779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.186935 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.187091 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.187246 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.187399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.187558 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.187723 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.187878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.188030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.188186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.188339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.188489 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.188653 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.188806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.188962 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.188962 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.189251 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.189404 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.189568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.189770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.189930 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.190084 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.190238 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.190389 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.190577 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.190731 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.190884 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.191039 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.connection = **** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.191204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.191369 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.191521 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.191684 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.191839 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.191993 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.192146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.192299 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.192455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.192621 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.192774 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.192928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.193082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.193241 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.193393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.193557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.193711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.193865 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.194019 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.194172 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.194326 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.194530 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.194530 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.194804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.194956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.195111 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.195111 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] token.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.195411 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.195567 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.195719 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.195719 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196004 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196317 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196473 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196628 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93694) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 20:34:18.196938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.196938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.198195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.198195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.198195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.198195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.198195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.connection = **** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.198195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.198195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.198195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.198195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.199424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.199424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.199424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.199424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.199424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.199424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.199424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.199424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.199424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.200360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.200360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.200360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.200360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.200360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 20:34:18.200360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93695) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 20:34:18.213471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.213705 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.213933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.217381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.217620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.217853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.223123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.227453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.250984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.251218 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.254347 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.254614 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.304718 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.306215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.353526 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.353709 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.356188 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.356439 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.420188 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.420368 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.420444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.420623 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.420749 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.420825 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.420900 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.421043 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.421180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.421258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.421334 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.421519 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.444557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.444698 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.444949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.445071 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.445149 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.445375 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.445499 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.445588 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.445664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.445775 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.445863 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.446031 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.446231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.446477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.456770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.457911 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.469459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.469702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.470141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.470223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.470369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.470520 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.470621 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.470695 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.470863 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.471205 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.471205 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.471325 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93694) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.471769 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.471769 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93695) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 25 20:34:18.488563 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.488754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 25 20:34:18.489100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.489283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 25 20:34:18.489376 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.489545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 25 20:34:18.489668 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.489834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.489955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.490046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 25 20:34:18.490117 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.490343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.490498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.490601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.490893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.491152 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.501066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.501528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.501803 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.501926 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.502063 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.502176 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.503093 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.503385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.510206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.511478 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.513481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.513762 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.514044 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.514324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.514632 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.514755 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.514865 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.515025 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.515146 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.515337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.515475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.515627 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.515752 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.515913 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.516038 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.516129 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.516339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.516463 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.516694 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.516963 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.517322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.517599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.542721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.544320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.544600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.544744 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.546333 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.546641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.550305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.550305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.550522 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.552572 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.552853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.553136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.557721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.557982 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.560700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.560980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.562400 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.562703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.562988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.563426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.563708 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.564094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.564372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.564667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.566361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.566679 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.566968 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.567255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.567544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.567805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.568264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.568457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.583215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.583493 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.587657 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.587945 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.588068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.591729 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.592024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.592568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.597007 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.597307 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.597513 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.601254 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.602277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.604850 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.605147 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.605427 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.605911 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.607320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.607614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.607902 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.609521 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.609823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.610112 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.610396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.610702 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.613140 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.626679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.626955 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.627222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.627496 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.632453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.632739 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.633012 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.633277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.635443 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.637149 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.637424 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.640447 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.640732 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.641011 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.641300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.641498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.641597 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.643740 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.644021 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.647076 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.647360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.647644 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.647949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.648233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.654853 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.655134 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.655413 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.655692 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.655974 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.656244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.656523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.662085 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.662369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.662681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.662965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.663251 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.663527 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.663811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.674184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.677539 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.680881 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.681973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.682458 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.684090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.684372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.684627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.685361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.688681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.690677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.691994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.692352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.692631 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.692928 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.693578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.696839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.697071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.697363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.697627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.700165 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.701892 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.705092 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.705411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.706274 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.706591 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.706769 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.707085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.707359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.715206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93694) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.715482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.715606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.715760 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.715904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.716009 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.716162 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.716328 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.716572 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.716839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.717102 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.717362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.717610 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.717876 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.718142 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.718401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.718678 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93694) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.724875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=93695) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 25 20:34:18.725160 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.725447 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.725725 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.726038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.726311 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.726687 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.726983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.727268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.727551 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.727822 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.728093 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.728361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.728639 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93695) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 25 20:34:18.756300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557d22fe9c0 pid: 93694 (default app) Jun 25 20:34:18.759592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d1d8-0d4e-4dc0-b29e-49eba87c3d6c None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:18.759880 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d1d8-0d4e-4dc0-b29e-49eba87c3d6c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:18.760152 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616d1d8-0d4e-4dc0-b29e-49eba87c3d6c None None] PATH_INFO: `/v3` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:18.764459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Sat Jun 25 20:34:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:18.766827 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5557d22fe9c0 pid: 93695 (default app) Jun 25 20:34:26.925354 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280270a-6d96-44de-a836-9d13f43259e8 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:26.925941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280270a-6d96-44de-a836-9d13f43259e8 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:26.925941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280270a-6d96-44de-a836-9d13f43259e8 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:26.927389 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:34:26.937381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:26.938132 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:26.938282 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:27.015292 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: INFO dbcounter [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] Registered counter for database keystone Jun 25 20:34:27.040117 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93695) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:34:27.052001 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writer thread running {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:34:27.348885 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG passlib.handlers.bcrypt [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93695) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 25 20:34:27.349300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG passlib.handlers.bcrypt [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93695) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 25 20:34:27.404310 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:27.405924 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:27.536509 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 1/3] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 604 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 25 20:34:27.692016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280270a-6d96-44de-a836-9d13f43259e8 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:27.779505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: INFO dbcounter [None req-e280270a-6d96-44de-a836-9d13f43259e8 None None] Registered counter for database keystone Jun 25 20:34:27.801631 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG oslo_db.sqlalchemy.engines [None req-e280270a-6d96-44de-a836-9d13f43259e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93694) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 20:34:27.813297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writer thread running {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 20:34:27.932639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280270a-6d96-44de-a836-9d13f43259e8 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:27.938091 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b6946-328e-4a7d-ac09-76be267a88d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:27.938789 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6946-328e-4a7d-ac09-76be267a88d7 admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:27.939082 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6946-328e-4a7d-ac09-76be267a88d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:27.939361 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b6946-328e-4a7d-ac09-76be267a88d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:27.948092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b6946-328e-4a7d-ac09-76be267a88d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:28.104212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ee0b6946-328e-4a7d-ac09-76be267a88d7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 25 20:34:28.104550 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b6946-328e-4a7d-ac09-76be267a88d7 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:28.116677 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Jun 25 20:34:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:34:28.125861 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:28.140967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7498a1-609c-4f48-af4f-d0720aa24d5b None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:28.147046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adaca9-9757-48b6-be16-9ae5ecb116de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:28.148166 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adaca9-9757-48b6-be16-9ae5ecb116de admin admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:28.148448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adaca9-9757-48b6-be16-9ae5ecb116de admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:28.148726 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adaca9-9757-48b6-be16-9ae5ecb116de admin admin] PATH_INFO: `/v3/projects/1a86de01022c4cb490a16df9dbe16261` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:28.150465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adaca9-9757-48b6-be16-9ae5ecb116de admin admin] RBAC: Authorizing `identity:get_project(project_id=1a86de01022c4cb490a16df9dbe16261)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:28.200815 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e3adaca9-9757-48b6-be16-9ae5ecb116de admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 25 20:34:28.201092 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adaca9-9757-48b6-be16-9ae5ecb116de admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:28.205725 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 2/5] 10.222.0.26 () {56 vars in 1207 bytes} [Sat Jun 25 20:34:28 2022] GET /identity/v3/projects/1a86de01022c4cb490a16df9dbe16261 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:30.541945 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e5fb-16e1-4e8f-a157-0c03434827b4 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:30.542779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e5fb-16e1-4e8f-a157-0c03434827b4 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:30.542779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0e5fb-16e1-4e8f-a157-0c03434827b4 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:30.549737 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 4/6] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:30.556463 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2154a-616b-4dab-a24a-690be2d95034 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:30.556930 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2154a-616b-4dab-a24a-690be2d95034 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:30.557046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2154a-616b-4dab-a24a-690be2d95034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:30.585112 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-6ac2154a-616b-4dab-a24a-690be2d95034 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:30.586708 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-6ac2154a-616b-4dab-a24a-690be2d95034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:30.596554 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 3/7] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 25 20:34:30.621015 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0e5fb-16e1-4e8f-a157-0c03434827b4 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:30.643888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0e5fb-16e1-4e8f-a157-0c03434827b4 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:30.649702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688b9cf-f399-424c-8d28-194140b1f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:30.650353 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688b9cf-f399-424c-8d28-194140b1f58d admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:30.650682 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688b9cf-f399-424c-8d28-194140b1f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:30.650961 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688b9cf-f399-424c-8d28-194140b1f58d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:30.659853 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688b9cf-f399-424c-8d28-194140b1f58d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:30.662173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688b9cf-f399-424c-8d28-194140b1f58d admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:30.671824 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 5/8] 10.222.0.26 () {58 vars in 1324 bytes} [Sat Jun 25 20:34:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 25 20:34:30.680073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2154a-616b-4dab-a24a-690be2d95034 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:30.692369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2154a-616b-4dab-a24a-690be2d95034 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:30.698783 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c192dadf-6a4a-4589-9cc1-97c9d8be240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:30.699671 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192dadf-6a4a-4589-9cc1-97c9d8be240e admin admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:30.699957 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192dadf-6a4a-4589-9cc1-97c9d8be240e admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:30.700239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c192dadf-6a4a-4589-9cc1-97c9d8be240e admin admin] PATH_INFO: `/v3/users/5c76b07e47a84c48b4608f75eeee3a3e` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:30.701874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192dadf-6a4a-4589-9cc1-97c9d8be240e admin admin] RBAC: Authorizing `identity:get_user(user_id=5c76b07e47a84c48b4608f75eeee3a3e)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:30.703789 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c192dadf-6a4a-4589-9cc1-97c9d8be240e admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:30.705434 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 4/9] 10.222.0.26 () {56 vars in 1198 bytes} [Sat Jun 25 20:34:30 2022] GET /identity/v3/users/5c76b07e47a84c48b4608f75eeee3a3e => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:33.012754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0207ea-4061-4e9c-9f27-ca7b1e29a3ee None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.013287 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0207ea-4061-4e9c-9f27-ca7b1e29a3ee None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.013287 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0207ea-4061-4e9c-9f27-ca7b1e29a3ee None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.014777 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:33.020232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88b5a2-5064-4354-ad1e-366cf9a808f9 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.020682 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88b5a2-5064-4354-ad1e-366cf9a808f9 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.020774 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88b5a2-5064-4354-ad1e-366cf9a808f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.038662 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-9e88b5a2-5064-4354-ad1e-366cf9a808f9 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:33.039848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-9e88b5a2-5064-4354-ad1e-366cf9a808f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:33.053310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26c52-9629-4144-adc5-71dde0873846 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.053601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26c52-9629-4144-adc5-71dde0873846 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.053887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a26c52-9629-4144-adc5-71dde0873846 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.055425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 7/11] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:33.060092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ecb2-33d9-44f9-a2f9-7ad21a00db55 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.060378 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ecb2-33d9-44f9-a2f9-7ad21a00db55 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.060657 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ecb2-33d9-44f9-a2f9-7ad21a00db55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.101327 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG passlib.handlers.bcrypt [None req-07c1ecb2-33d9-44f9-a2f9-7ad21a00db55 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93694) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 25 20:34:33.101726 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG passlib.handlers.bcrypt [None req-07c1ecb2-33d9-44f9-a2f9-7ad21a00db55 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93694) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 25 20:34:33.127720 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 5/12] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:33.146739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-07c1ecb2-33d9-44f9-a2f9-7ad21a00db55 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:33.148348 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-07c1ecb2-33d9-44f9-a2f9-7ad21a00db55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:33.151914 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88b5a2-5064-4354-ad1e-366cf9a808f9 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:33.176737 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:33.248550 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 8/13] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:34:33.257833 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88b5a2-5064-4354-ad1e-366cf9a808f9 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:33.272653 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1ecb2-33d9-44f9-a2f9-7ad21a00db55 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:33.292105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37391f-0cda-42ec-8dc0-a7ad23ad224a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:33.292932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37391f-0cda-42ec-8dc0-a7ad23ad224a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.293223 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37391f-0cda-42ec-8dc0-a7ad23ad224a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.293504 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37391f-0cda-42ec-8dc0-a7ad23ad224a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.309118 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37391f-0cda-42ec-8dc0-a7ad23ad224a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-fe37391f-0cda-42ec-8dc0-a7ad23ad224a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:33.321108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:33.322041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:34:33.322903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 6/14] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:34:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:34:33.328262 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37391f-0cda-42ec-8dc0-a7ad23ad224a None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:33.392681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1ecb2-33d9-44f9-a2f9-7ad21a00db55 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:33.395646 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:33.414540 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:33.431482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c52f2b-90c8-4a61-a385-a146e28cb0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:33.432394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c52f2b-90c8-4a61-a385-a146e28cb0d3 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.432687 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c52f2b-90c8-4a61-a385-a146e28cb0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.432969 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c52f2b-90c8-4a61-a385-a146e28cb0d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.433993 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37391f-0cda-42ec-8dc0-a7ad23ad224a None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:33.472207 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885538a0-d282-45a1-bc47-3c81e56b461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:33.472894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885538a0-d282-45a1-bc47-3c81e56b461f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.473183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885538a0-d282-45a1-bc47-3c81e56b461f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.473492 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885538a0-d282-45a1-bc47-3c81e56b461f None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.474249 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885538a0-d282-45a1-bc47-3c81e56b461f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:33.474613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885538a0-d282-45a1-bc47-3c81e56b461f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:33.476048 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885538a0-d282-45a1-bc47-3c81e56b461f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:33.489453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 7/15] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:33.495048 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885538a0-d282-45a1-bc47-3c81e56b461f None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:33.503537 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c52f2b-90c8-4a61-a385-a146e28cb0d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:33.505030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c52f2b-90c8-4a61-a385-a146e28cb0d3 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:33.591891 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885538a0-d282-45a1-bc47-3c81e56b461f None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:33.605655 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 9/16] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:34:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:34:33.611750 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c52f2b-90c8-4a61-a385-a146e28cb0d3 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:33.614516 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:33.625621 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2b0b-b519-4744-87a9-c3e3e522bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:33.626769 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2b0b-b519-4744-87a9-c3e3e522bc53 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.627049 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2b0b-b519-4744-87a9-c3e3e522bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.627324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b2b0b-b519-4744-87a9-c3e3e522bc53 None admin] PATH_INFO: `/v3/users/5c76b07e47a84c48b4608f75eeee3a3e` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.628758 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2b0b-b519-4744-87a9-c3e3e522bc53 None admin] RBAC: Authorizing `identity:get_user(user_id=5c76b07e47a84c48b4608f75eeee3a3e)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:33.630312 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b2b0b-b519-4744-87a9-c3e3e522bc53 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:33.631982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 8/17] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:33 2022] GET /identity/v3/users/5c76b07e47a84c48b4608f75eeee3a3e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:33.637392 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2b0b-b519-4744-87a9-c3e3e522bc53 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:33.653833 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:33.719121 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c52f2b-90c8-4a61-a385-a146e28cb0d3 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:33.747140 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b2b0b-b519-4744-87a9-c3e3e522bc53 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:33.754763 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cd1e3-6f21-4d38-bf89-aa927fc48633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:33.755510 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cd1e3-6f21-4d38-bf89-aa927fc48633 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.755805 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cd1e3-6f21-4d38-bf89-aa927fc48633 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.756089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794cd1e3-6f21-4d38-bf89-aa927fc48633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.774613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cd1e3-6f21-4d38-bf89-aa927fc48633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:33.776115 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794cd1e3-6f21-4d38-bf89-aa927fc48633 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:33.780168 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6125b8-57bd-426b-bd0c-097f31210196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:33.780967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6125b8-57bd-426b-bd0c-097f31210196 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.781256 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6125b8-57bd-426b-bd0c-097f31210196 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.781536 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6125b8-57bd-426b-bd0c-097f31210196 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.782765 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6125b8-57bd-426b-bd0c-097f31210196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:33.784329 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6125b8-57bd-426b-bd0c-097f31210196 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:33.785991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:33.791721 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6125b8-57bd-426b-bd0c-097f31210196 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-794cd1e3-6f21-4d38-bf89-aa927fc48633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:34:33.796903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:33.797745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:33.798764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:34:33.798764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:34:33.798764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:34:33.798764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:34:33.798764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:34:33.804051 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cd1e3-6f21-4d38-bf89-aa927fc48633 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:33.861247 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:33.871622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:33.890979 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6125b8-57bd-426b-bd0c-097f31210196 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:33.906369 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794cd1e3-6f21-4d38-bf89-aa927fc48633 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:33.924960 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a652b-2f52-4162-bde5-bd9edb87041c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:33.925629 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a652b-2f52-4162-bde5-bd9edb87041c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.925922 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a652b-2f52-4162-bde5-bd9edb87041c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.926205 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a652b-2f52-4162-bde5-bd9edb87041c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.927085 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a652b-2f52-4162-bde5-bd9edb87041c None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.domain.id=default, user.id=5c76b07e47a84c48b4608f75eeee3a3e) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:33.927488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a652b-2f52-4162-bde5-bd9edb87041c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:33.928888 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a652b-2f52-4162-bde5-bd9edb87041c None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:33.935947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 10/20] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Jun 25 20:34:33 2022] GET /identity/v3/role_assignments?user.id=5c76b07e47a84c48b4608f75eeee3a3e&scope.domain.id=default&role.id=8e22816a513845d88f4934c2164a142b => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:33.941248 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104a44f-bc27-4844-a50a-c0e3b664c365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:33.941929 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a44f-bc27-4844-a50a-c0e3b664c365 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:33.942211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a44f-bc27-4844-a50a-c0e3b664c365 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:33.942536 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104a44f-bc27-4844-a50a-c0e3b664c365 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:33.943272 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104a44f-bc27-4844-a50a-c0e3b664c365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:33.943583 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104a44f-bc27-4844-a50a-c0e3b664c365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:33.945024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104a44f-bc27-4844-a50a-c0e3b664c365 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:33.965263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 11/21] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:36.553864 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f470f-c546-49e8-9cf7-177fd4f07fdd None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:36.554409 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f470f-c546-49e8-9cf7-177fd4f07fdd None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:36.554409 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f470f-c546-49e8-9cf7-177fd4f07fdd None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:36.555822 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 11/22] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:36.561384 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a29cd-bfb7-434e-b789-8887b238e929 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:36.561888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a29cd-bfb7-434e-b789-8887b238e929 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:36.561968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a29cd-bfb7-434e-b789-8887b238e929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:36.584831 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-5b2a29cd-bfb7-434e-b789-8887b238e929 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:36.586267 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-5b2a29cd-bfb7-434e-b789-8887b238e929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:36.682948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:36.718732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f470f-c546-49e8-9cf7-177fd4f07fdd None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:36.875190 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f470f-c546-49e8-9cf7-177fd4f07fdd None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:36.922264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a17cdd-5ced-4925-9dbc-fa255b5efebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:36.923106 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a17cdd-5ced-4925-9dbc-fa255b5efebb None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:36.923392 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a17cdd-5ced-4925-9dbc-fa255b5efebb None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:36.923979 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a17cdd-5ced-4925-9dbc-fa255b5efebb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:36.944783 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a17cdd-5ced-4925-9dbc-fa255b5efebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-f3a17cdd-5ced-4925-9dbc-fa255b5efebb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:36.952474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:36.953336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:34:36.954079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 12/24] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:36.963586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a29cd-bfb7-434e-b789-8887b238e929 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:37.038545 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:37.068767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297a185-f835-4c9d-9815-f61c81144937 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.069195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297a185-f835-4c9d-9815-f61c81144937 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.069614 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297a185-f835-4c9d-9815-f61c81144937 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.072345 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 13/25] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:37.078198 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448be78-93a5-4a54-9bee-98a9f0a1e5e0 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.078666 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448be78-93a5-4a54-9bee-98a9f0a1e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.079132 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448be78-93a5-4a54-9bee-98a9f0a1e5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.096713 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:37.123674 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-8448be78-93a5-4a54-9bee-98a9f0a1e5e0 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:37.124901 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-8448be78-93a5-4a54-9bee-98a9f0a1e5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:37.126244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a29cd-bfb7-434e-b789-8887b238e929 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:37.196339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b00f7-102f-4728-be3c-fa0e20091de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:37.197350 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b00f7-102f-4728-be3c-fa0e20091de2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.197641 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b00f7-102f-4728-be3c-fa0e20091de2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.197922 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b00f7-102f-4728-be3c-fa0e20091de2 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.198724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b00f7-102f-4728-be3c-fa0e20091de2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:37.199034 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b00f7-102f-4728-be3c-fa0e20091de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:37.200499 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b00f7-102f-4728-be3c-fa0e20091de2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:37.223961 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 13/26] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:37.230031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b00f7-102f-4728-be3c-fa0e20091de2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:37.295938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:37.347582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448be78-93a5-4a54-9bee-98a9f0a1e5e0 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:37.404784 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b00f7-102f-4728-be3c-fa0e20091de2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:37.414730 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:37.447616 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c0aa1-dac9-4eae-8010-d3dbbff924a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:37.449455 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c0aa1-dac9-4eae-8010-d3dbbff924a5 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.449996 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c0aa1-dac9-4eae-8010-d3dbbff924a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.450437 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c0aa1-dac9-4eae-8010-d3dbbff924a5 None admin] PATH_INFO: `/v3/users/5c76b07e47a84c48b4608f75eeee3a3e` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.453297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c0aa1-dac9-4eae-8010-d3dbbff924a5 None admin] RBAC: Authorizing `identity:get_user(user_id=5c76b07e47a84c48b4608f75eeee3a3e)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:37.455155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c0aa1-dac9-4eae-8010-d3dbbff924a5 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:37.456967 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 14/28] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:37 2022] GET /identity/v3/users/5c76b07e47a84c48b4608f75eeee3a3e => generated 247 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:37.458947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac1065-a215-410a-bd35-d618068d5fac None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.459371 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac1065-a215-410a-bd35-d618068d5fac None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.459825 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac1065-a215-410a-bd35-d618068d5fac None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.461167 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 15/29] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:37.466128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cedeed-0e95-4db7-82a5-2cca91178ebd None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.466812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cedeed-0e95-4db7-82a5-2cca91178ebd None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.467099 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cedeed-0e95-4db7-82a5-2cca91178ebd None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.468544 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:37.471601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cedeed-0e95-4db7-82a5-2cca91178ebd None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:37.503262 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448be78-93a5-4a54-9bee-98a9f0a1e5e0 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:37.549747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c8b4f-654f-469f-b745-9fb20ef780aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:37.551186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8b4f-654f-469f-b745-9fb20ef780aa None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.551714 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8b4f-654f-469f-b745-9fb20ef780aa None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.552376 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c8b4f-654f-469f-b745-9fb20ef780aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.555354 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:37.568620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c8b4f-654f-469f-b745-9fb20ef780aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:37.571104 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c8b4f-654f-469f-b745-9fb20ef780aa None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:37.589378 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cedeed-0e95-4db7-82a5-2cca91178ebd None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e98c8b4f-654f-469f-b745-9fb20ef780aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:34:37.597664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:37.598466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:37.599263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:34:37.599263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:34:37.599263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:34:37.599263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:34:37.601972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 15/31] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:37.603787 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a683e85-45d8-45ac-af4c-f6277b3a9d78 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.604555 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a683e85-45d8-45ac-af4c-f6277b3a9d78 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.605057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a683e85-45d8-45ac-af4c-f6277b3a9d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.628334 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-9a683e85-45d8-45ac-af4c-f6277b3a9d78 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:37.628596 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187fe2c9-85cb-4745-8dc9-b9b1f4320fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:37.629604 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fe2c9-85cb-4745-8dc9-b9b1f4320fa7 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.629951 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fe2c9-85cb-4745-8dc9-b9b1f4320fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.630296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187fe2c9-85cb-4745-8dc9-b9b1f4320fa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.630733 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-9a683e85-45d8-45ac-af4c-f6277b3a9d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:37.631774 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fe2c9-85cb-4745-8dc9-b9b1f4320fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:37.633366 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187fe2c9-85cb-4745-8dc9-b9b1f4320fa7 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:37.636496 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 17/32] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:37.643463 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a69e5e-0906-4286-a1ab-aa6da8ebe412 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.643762 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a69e5e-0906-4286-a1ab-aa6da8ebe412 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.644138 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a69e5e-0906-4286-a1ab-aa6da8ebe412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.666570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-e9a69e5e-0906-4286-a1ab-aa6da8ebe412 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:37.668100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-e9a69e5e-0906-4286-a1ab-aa6da8ebe412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:37.720377 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:37.721646 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 16/33] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:37.727748 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a683e85-45d8-45ac-af4c-f6277b3a9d78 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:37.766049 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 18/34] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:37.766907 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a69e5e-0906-4286-a1ab-aa6da8ebe412 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:37.867309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a683e85-45d8-45ac-af4c-f6277b3a9d78 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:37.881782 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a69e5e-0906-4286-a1ab-aa6da8ebe412 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:37.885658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:37.906589 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d4a1-86b3-4cb9-b9d7-e9421b18abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:37.907263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d4a1-86b3-4cb9-b9d7-e9421b18abd4 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.907548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d4a1-86b3-4cb9-b9d7-e9421b18abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.907867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d4a1-86b3-4cb9-b9d7-e9421b18abd4 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.908599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1d4a1-86b3-4cb9-b9d7-e9421b18abd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:37.908908 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1d4a1-86b3-4cb9-b9d7-e9421b18abd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:37.910329 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1d4a1-86b3-4cb9-b9d7-e9421b18abd4 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:37.928131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d92b6d-4847-4e1a-8e65-9a819c6e2f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:37.933469 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 17/35] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:37.933623 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d92b6d-4847-4e1a-8e65-9a819c6e2f12 None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:37.933623 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d92b6d-4847-4e1a-8e65-9a819c6e2f12 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:37.933623 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d92b6d-4847-4e1a-8e65-9a819c6e2f12 None admin] PATH_INFO: `/v3/domains/default/users/5c76b07e47a84c48b4608f75eeee3a3e/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:37.933834 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d4a1-86b3-4cb9-b9d7-e9421b18abd4 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:37.935045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d92b6d-4847-4e1a-8e65-9a819c6e2f12 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c76b07e47a84c48b4608f75eeee3a3e, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:37.936538 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d92b6d-4847-4e1a-8e65-9a819c6e2f12 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:38.046027 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d4a1-86b3-4cb9-b9d7-e9421b18abd4 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:38.066477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 19/36] 10.222.0.26 () {58 vars in 1361 bytes} [Sat Jun 25 20:34:37 2022] PUT /identity/v3/domains/default/users/5c76b07e47a84c48b4608f75eeee3a3e/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:34:38.066477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d92b6d-4847-4e1a-8e65-9a819c6e2f12 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:38.102948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:38.106309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57979365-09a1-4d50-8c0b-6cbedaa17390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:38.107057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57979365-09a1-4d50-8c0b-6cbedaa17390 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:38.107346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57979365-09a1-4d50-8c0b-6cbedaa17390 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:38.107627 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57979365-09a1-4d50-8c0b-6cbedaa17390 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:38.108550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57979365-09a1-4d50-8c0b-6cbedaa17390 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:38.110676 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57979365-09a1-4d50-8c0b-6cbedaa17390 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:38.193822 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d92b6d-4847-4e1a-8e65-9a819c6e2f12 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:38.233882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986041b-4b85-4226-9e4a-2aa62d59820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:38.234609 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986041b-4b85-4226-9e4a-2aa62d59820a None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:38.234905 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986041b-4b85-4226-9e4a-2aa62d59820a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:38.235195 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986041b-4b85-4226-9e4a-2aa62d59820a None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:38.236009 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986041b-4b85-4226-9e4a-2aa62d59820a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:38.237784 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986041b-4b85-4226-9e4a-2aa62d59820a None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:38.258066 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Jun 25 20:34:37 2022] POST /identity/v3/roles => generated 219 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:34:38.267354 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a17d0-a9e5-420f-9b3b-439cc564fd2c None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:38.268150 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a17d0-a9e5-420f-9b3b-439cc564fd2c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:38.268150 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a17d0-a9e5-420f-9b3b-439cc564fd2c None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:38.271349 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 20/39] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Jun 25 20:34:38 2022] POST /identity/v3/roles => generated 225 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:34:38.272193 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986041b-4b85-4226-9e4a-2aa62d59820a None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:38.273910 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 19/39] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:38.278195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2d33-ee2d-42c0-a59d-b305835f981f None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:38.278572 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2d33-ee2d-42c0-a59d-b305835f981f None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:38.278924 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2d33-ee2d-42c0-a59d-b305835f981f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:38.305474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-478c2d33-ee2d-42c0-a59d-b305835f981f None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:38.307149 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-478c2d33-ee2d-42c0-a59d-b305835f981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:38.354870 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:38.439637 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:38.444072 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 20/40] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:34:38.451784 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986041b-4b85-4226-9e4a-2aa62d59820a None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:38.492302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113e622-a616-47cb-b198-9134f8b912c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:38.493380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e622-a616-47cb-b198-9134f8b912c1 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:38.493862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e622-a616-47cb-b198-9134f8b912c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:38.494344 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113e622-a616-47cb-b198-9134f8b912c1 None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:38.495367 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113e622-a616-47cb-b198-9134f8b912c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:38.497161 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113e622-a616-47cb-b198-9134f8b912c1 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:38.503936 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2d33-ee2d-42c0-a59d-b305835f981f None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:38.539458 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 21/41] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:34:38 2022] POST /identity/v3/projects => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:34:38.547454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d002a-95a9-4d19-8cd8-9333bb806490 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:38.547821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d002a-95a9-4d19-8cd8-9333bb806490 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:38.548045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d002a-95a9-4d19-8cd8-9333bb806490 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:38.549557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 22/42] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:38.555597 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4c583-4dab-4a6c-a100-fb5520f4b119 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:38.555942 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4c583-4dab-4a6c-a100-fb5520f4b119 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:38.556191 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4c583-4dab-4a6c-a100-fb5520f4b119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:38.574965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-6cc4c583-4dab-4a6c-a100-fb5520f4b119 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:38.576574 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-6cc4c583-4dab-4a6c-a100-fb5520f4b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:38.662231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2d33-ee2d-42c0-a59d-b305835f981f None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:38.663228 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 23/43] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:34:38.693521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4c583-4dab-4a6c-a100-fb5520f4b119 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:38.704442 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdc795-32ca-4171-9a7a-152ba53ff26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:38.705550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdc795-32ca-4171-9a7a-152ba53ff26a None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:38.706608 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdc795-32ca-4171-9a7a-152ba53ff26a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:38.707106 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdc795-32ca-4171-9a7a-152ba53ff26a None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:38.708516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdc795-32ca-4171-9a7a-152ba53ff26a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:38.710874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdc795-32ca-4171-9a7a-152ba53ff26a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:38.735513 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 21/44] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Jun 25 20:34:38 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:34:38.796027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:38.830141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4c583-4dab-4a6c-a100-fb5520f4b119 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:38.870453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef546f2-2e64-4e3b-953a-8043b5708f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:38.871287 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef546f2-2e64-4e3b-953a-8043b5708f36 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:38.871573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef546f2-2e64-4e3b-953a-8043b5708f36 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:38.871853 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef546f2-2e64-4e3b-953a-8043b5708f36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:38.873102 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef546f2-2e64-4e3b-953a-8043b5708f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:38.874650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef546f2-2e64-4e3b-953a-8043b5708f36 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:38.876327 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 24/45] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:38.882163 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdc795-32ca-4171-9a7a-152ba53ff26a None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:38.915146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:39.001145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdc795-32ca-4171-9a7a-152ba53ff26a None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:39.042754 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addd49e6-f39d-4386-8310-bd8011a464c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:39.043476 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd49e6-f39d-4386-8310-bd8011a464c5 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:39.043754 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd49e6-f39d-4386-8310-bd8011a464c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:39.044038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addd49e6-f39d-4386-8310-bd8011a464c5 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:39.044775 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd49e6-f39d-4386-8310-bd8011a464c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:39.046260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addd49e6-f39d-4386-8310-bd8011a464c5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:39.074192 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 22/46] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:34:38 2022] POST /identity/v3/projects => generated 312 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:34:40.639914 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579d767-cdb8-4b3d-bc9d-e994a80c9e11 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:40.640467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579d767-cdb8-4b3d-bc9d-e994a80c9e11 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:40.640467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579d767-cdb8-4b3d-bc9d-e994a80c9e11 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:40.641898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 25/47] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:40.647579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9071a-88fa-45da-85d1-ed210274380e None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:40.648000 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9071a-88fa-45da-85d1-ed210274380e None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:40.648128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9071a-88fa-45da-85d1-ed210274380e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:40.666397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-41b9071a-88fa-45da-85d1-ed210274380e None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:40.667643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-41b9071a-88fa-45da-85d1-ed210274380e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:40.736727 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 23/48] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:40.760962 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579d767-cdb8-4b3d-bc9d-e994a80c9e11 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:40.868057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579d767-cdb8-4b3d-bc9d-e994a80c9e11 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:40.903374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43ba52-954a-4f3c-93b2-39bf77782b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:40.904084 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43ba52-954a-4f3c-93b2-39bf77782b6e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:40.904373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43ba52-954a-4f3c-93b2-39bf77782b6e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:40.904653 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43ba52-954a-4f3c-93b2-39bf77782b6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:40.916397 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43ba52-954a-4f3c-93b2-39bf77782b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-8e43ba52-954a-4f3c-93b2-39bf77782b6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:40.925202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:40.926071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:34:40.931721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 26/49] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:40.932830 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9071a-88fa-45da-85d1-ed210274380e None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:40.943034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:41.036773 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9071a-88fa-45da-85d1-ed210274380e None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:41.071983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800249b-3d2f-4fcc-a2ea-16ee5c1a25fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:41.072666 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800249b-3d2f-4fcc-a2ea-16ee5c1a25fa None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:41.072951 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800249b-3d2f-4fcc-a2ea-16ee5c1a25fa None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:41.073232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800249b-3d2f-4fcc-a2ea-16ee5c1a25fa None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:41.073980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800249b-3d2f-4fcc-a2ea-16ee5c1a25fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:41.074291 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800249b-3d2f-4fcc-a2ea-16ee5c1a25fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:41.075748 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800249b-3d2f-4fcc-a2ea-16ee5c1a25fa None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:41.084630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 24/50] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:41.090173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43ba52-954a-4f3c-93b2-39bf77782b6e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:41.095171 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:41.200052 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43ba52-954a-4f3c-93b2-39bf77782b6e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:41.234654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777efda0-980e-42a3-b1fb-796dfe77cea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:41.235537 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777efda0-980e-42a3-b1fb-796dfe77cea2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:41.235825 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777efda0-980e-42a3-b1fb-796dfe77cea2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:41.236102 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777efda0-980e-42a3-b1fb-796dfe77cea2 None admin] PATH_INFO: `/v3/users/5c76b07e47a84c48b4608f75eeee3a3e` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:41.237346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777efda0-980e-42a3-b1fb-796dfe77cea2 None admin] RBAC: Authorizing `identity:get_user(user_id=5c76b07e47a84c48b4608f75eeee3a3e)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:41.238839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777efda0-980e-42a3-b1fb-796dfe77cea2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:41.240479 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 27/51] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:41 2022] GET /identity/v3/users/5c76b07e47a84c48b4608f75eeee3a3e => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:41.246049 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800249b-3d2f-4fcc-a2ea-16ee5c1a25fa None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:41.318957 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:41.351616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800249b-3d2f-4fcc-a2ea-16ee5c1a25fa None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:41.358481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239940a-236f-4708-b856-4c19af7df052 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:41.358783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239940a-236f-4708-b856-4c19af7df052 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:41.359065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239940a-236f-4708-b856-4c19af7df052 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:41.360440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 28/52] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:41.366023 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476f698-58d7-4019-ad89-8e57b2d9b920 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:41.366316 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476f698-58d7-4019-ad89-8e57b2d9b920 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:41.366629 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476f698-58d7-4019-ad89-8e57b2d9b920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:41.384044 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-b476f698-58d7-4019-ad89-8e57b2d9b920 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:41.385266 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-b476f698-58d7-4019-ad89-8e57b2d9b920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:41.388346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2edfcb-baf6-48b2-b89d-668526527000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:41.389173 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2edfcb-baf6-48b2-b89d-668526527000 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:41.389450 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2edfcb-baf6-48b2-b89d-668526527000 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:41.389738 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2edfcb-baf6-48b2-b89d-668526527000 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:41.390983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2edfcb-baf6-48b2-b89d-668526527000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:41.392746 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2edfcb-baf6-48b2-b89d-668526527000 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:41.394406 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 25/53] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:41.400382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2edfcb-baf6-48b2-b89d-668526527000 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:41.457635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 29/54] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:41.483201 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476f698-58d7-4019-ad89-8e57b2d9b920 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:41.485530 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:41.505264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2edfcb-baf6-48b2-b89d-668526527000 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:41.538765 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd5a67-920b-481e-a862-fd6c4c33c5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:41.539432 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd5a67-920b-481e-a862-fd6c4c33c5ad None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:41.539727 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd5a67-920b-481e-a862-fd6c4c33c5ad None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:41.540011 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd5a67-920b-481e-a862-fd6c4c33c5ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:41.540852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd5a67-920b-481e-a862-fd6c4c33c5ad None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.domain.id=default, user.id=5c76b07e47a84c48b4608f75eeee3a3e) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:41.541173 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd5a67-920b-481e-a862-fd6c4c33c5ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:41.542722 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd5a67-920b-481e-a862-fd6c4c33c5ad None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:41.549006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 26/55] 10.222.0.26 () {56 vars in 1322 bytes} [Sat Jun 25 20:34:41 2022] GET /identity/v3/role_assignments?user.id=5c76b07e47a84c48b4608f75eeee3a3e&scope.domain.id=default&role.id=8e22816a513845d88f4934c2164a142b => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:41.591599 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476f698-58d7-4019-ad89-8e57b2d9b920 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:41.630175 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6514b0-6df4-42bf-a4ef-f84e3b7ad17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:41.631018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6514b0-6df4-42bf-a4ef-f84e3b7ad17f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:41.631306 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6514b0-6df4-42bf-a4ef-f84e3b7ad17f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:41.631586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6514b0-6df4-42bf-a4ef-f84e3b7ad17f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:41.632870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6514b0-6df4-42bf-a4ef-f84e3b7ad17f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:41.634378 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6514b0-6df4-42bf-a4ef-f84e3b7ad17f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:41.636105 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 30/56] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:41.642089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd5a67-920b-481e-a862-fd6c4c33c5ad None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:41.645415 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:41.752329 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd5a67-920b-481e-a862-fd6c4c33c5ad None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:41.789018 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c32eb-8730-469f-b0ef-7a54fd67b3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:41.789692 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c32eb-8730-469f-b0ef-7a54fd67b3d3 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:41.789979 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c32eb-8730-469f-b0ef-7a54fd67b3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:41.790272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c32eb-8730-469f-b0ef-7a54fd67b3d3 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:41.791046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c32eb-8730-469f-b0ef-7a54fd67b3d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:41.792524 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c32eb-8730-469f-b0ef-7a54fd67b3d3 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:41.820825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 27/57] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Jun 25 20:34:41 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:34:44.095352 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274a88b-8667-4bcf-8423-fa0186fc3413 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:44.095895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274a88b-8667-4bcf-8423-fa0186fc3413 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:44.095895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a274a88b-8667-4bcf-8423-fa0186fc3413 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:44.098036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 31/58] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:44.106925 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786a034-0414-4e8b-84eb-c9067a9ed4f2 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:44.107327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786a034-0414-4e8b-84eb-c9067a9ed4f2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:44.107572 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786a034-0414-4e8b-84eb-c9067a9ed4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:44.126864 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-f786a034-0414-4e8b-84eb-c9067a9ed4f2 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:44.128066 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-f786a034-0414-4e8b-84eb-c9067a9ed4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:44.180033 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:44.197908 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 28/59] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:44.224587 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274a88b-8667-4bcf-8423-fa0186fc3413 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:44.321147 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:44.355022 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a274a88b-8667-4bcf-8423-fa0186fc3413 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:44.391094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a519e95-b8b1-4834-bde6-c009e46a7cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:44.391918 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a519e95-b8b1-4834-bde6-c009e46a7cd4 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:44.392215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a519e95-b8b1-4834-bde6-c009e46a7cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:44.392474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a519e95-b8b1-4834-bde6-c009e46a7cd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:44.393782 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a519e95-b8b1-4834-bde6-c009e46a7cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:44.395306 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a519e95-b8b1-4834-bde6-c009e46a7cd4 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:44.396924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 32/60] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:44.405060 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786a034-0414-4e8b-84eb-c9067a9ed4f2 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:44.507494 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786a034-0414-4e8b-84eb-c9067a9ed4f2 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:44.543737 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd78483-6584-4ed1-8c0d-1fbbbc31bb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:44.544406 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78483-6584-4ed1-8c0d-1fbbbc31bb88 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:44.544699 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78483-6584-4ed1-8c0d-1fbbbc31bb88 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:44.544982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd78483-6584-4ed1-8c0d-1fbbbc31bb88 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:44.545696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd78483-6584-4ed1-8c0d-1fbbbc31bb88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:44.547288 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd78483-6584-4ed1-8c0d-1fbbbc31bb88 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:44.578096 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 29/61] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:34:44 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:34:48.109930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91466a6b-0af0-40db-9d38-28ff71dc12f9 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.109930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91466a6b-0af0-40db-9d38-28ff71dc12f9 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.109930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91466a6b-0af0-40db-9d38-28ff71dc12f9 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.111020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 33/62] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:48.116589 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e03b81-4f75-41ae-aa38-ea404d41470a None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.117351 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e03b81-4f75-41ae-aa38-ea404d41470a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.117790 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e03b81-4f75-41ae-aa38-ea404d41470a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.122067 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4992-efb9-42ec-88e4-9a3fd5b62867 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.123701 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4992-efb9-42ec-88e4-9a3fd5b62867 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.124178 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba4992-efb9-42ec-88e4-9a3fd5b62867 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.129527 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 34/63] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:48.132645 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a026846-9549-4bd2-b2bd-763d51b67cf4 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.133129 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a026846-9549-4bd2-b2bd-763d51b67cf4 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.133597 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a026846-9549-4bd2-b2bd-763d51b67cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.154688 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-10e03b81-4f75-41ae-aa38-ea404d41470a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:48.156243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-10e03b81-4f75-41ae-aa38-ea404d41470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:48.170589 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-8a026846-9549-4bd2-b2bd-763d51b67cf4 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:48.171801 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-8a026846-9549-4bd2-b2bd-763d51b67cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:48.209044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:48.245946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 30/64] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:34:48.270687 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e03b81-4f75-41ae-aa38-ea404d41470a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:48.330649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 35/65] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:48.369461 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a026846-9549-4bd2-b2bd-763d51b67cf4 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:48.371531 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e03b81-4f75-41ae-aa38-ea404d41470a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:48.408153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7edb5-77f1-4919-9101-080881a545b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:48.409351 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7edb5-77f1-4919-9101-080881a545b0 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.409851 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7edb5-77f1-4919-9101-080881a545b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.410324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a7edb5-77f1-4919-9101-080881a545b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.423033 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a7edb5-77f1-4919-9101-080881a545b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-16a7edb5-77f1-4919-9101-080881a545b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:48.431380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:48.432300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:48.433058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:34:48.435691 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 31/66] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:48.452509 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7edb5-77f1-4919-9101-080881a545b0 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:48.489845 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:48.514618 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:48.559905 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a026846-9549-4bd2-b2bd-763d51b67cf4 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:48.597359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a7edb5-77f1-4919-9101-080881a545b0 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:48.599645 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396698b-0cb2-4d32-9b10-703d64c1c916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:48.601515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396698b-0cb2-4d32-9b10-703d64c1c916 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.601874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396698b-0cb2-4d32-9b10-703d64c1c916 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.602221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396698b-0cb2-4d32-9b10-703d64c1c916 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.615338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396698b-0cb2-4d32-9b10-703d64c1c916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-4396698b-0cb2-4d32-9b10-703d64c1c916 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:48.625606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:48.626626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:48.627382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:34:48.627949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 36/67] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:34:48.629545 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95509a-1ef4-406e-a63f-aac3abcf5a56 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.630060 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95509a-1ef4-406e-a63f-aac3abcf5a56 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.630363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95509a-1ef4-406e-a63f-aac3abcf5a56 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.632462 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 37/68] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:48.635234 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95509a-1ef4-406e-a63f-aac3abcf5a56 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:48.643537 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cd337-b811-4ac3-80d0-87db91163f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:48.644227 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cd337-b811-4ac3-80d0-87db91163f79 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.644518 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cd337-b811-4ac3-80d0-87db91163f79 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.644804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cd337-b811-4ac3-80d0-87db91163f79 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.645691 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cd337-b811-4ac3-80d0-87db91163f79 None admin] RBAC: Adding query filter params (name=member) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:48.646008 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cd337-b811-4ac3-80d0-87db91163f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:48.647579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cd337-b811-4ac3-80d0-87db91163f79 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:48.657006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 32/69] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:34:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:48.658431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b440e-172f-44f8-81a1-8baae0e54399 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.658832 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b440e-172f-44f8-81a1-8baae0e54399 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.659206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b440e-172f-44f8-81a1-8baae0e54399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.676136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-916b440e-172f-44f8-81a1-8baae0e54399 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:48.677746 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-916b440e-172f-44f8-81a1-8baae0e54399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:48.746008 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 33/70] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:48.746964 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b440e-172f-44f8-81a1-8baae0e54399 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:48.747670 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95509a-1ef4-406e-a63f-aac3abcf5a56 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:48.772855 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:48.775587 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:48.783889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133d9cb-ac6c-421d-beda-ed4a964404ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:48.784550 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133d9cb-ac6c-421d-beda-ed4a964404ec None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.784870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133d9cb-ac6c-421d-beda-ed4a964404ec None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.785152 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133d9cb-ac6c-421d-beda-ed4a964404ec None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.785912 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133d9cb-ac6c-421d-beda-ed4a964404ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:48.786207 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133d9cb-ac6c-421d-beda-ed4a964404ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:48.787638 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133d9cb-ac6c-421d-beda-ed4a964404ec None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:48.796242 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 38/71] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:48.797536 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626ef0-881d-4851-b35e-48d1cdc5bd70 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.797851 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626ef0-881d-4851-b35e-48d1cdc5bd70 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.798172 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c626ef0-881d-4851-b35e-48d1cdc5bd70 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.799427 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 39/72] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:48.802538 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e9c78-ef04-4cc1-b96a-9fe68afe145e None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.802538 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e9c78-ef04-4cc1-b96a-9fe68afe145e None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.802538 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e9c78-ef04-4cc1-b96a-9fe68afe145e None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.802750 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 40/73] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:48.803556 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e9c78-ef04-4cc1-b96a-9fe68afe145e None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:48.867559 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b440e-172f-44f8-81a1-8baae0e54399 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:48.905604 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5e7d-b277-4cd1-bf4b-a9d7fcf6ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:48.906532 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5e7d-b277-4cd1-bf4b-a9d7fcf6ed7f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.906713 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e9c78-ef04-4cc1-b96a-9fe68afe145e None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:48.906846 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5e7d-b277-4cd1-bf4b-a9d7fcf6ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.907094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5e7d-b277-4cd1-bf4b-a9d7fcf6ed7f None admin] PATH_INFO: `/v3/users/84fa788ab3d84dc2ae333d817ad98651` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.922973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5e7d-b277-4cd1-bf4b-a9d7fcf6ed7f None admin] RBAC: Authorizing `identity:get_user(user_id=84fa788ab3d84dc2ae333d817ad98651)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:48.924654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5e7d-b277-4cd1-bf4b-a9d7fcf6ed7f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:48.926399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 34/74] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:48 2022] GET /identity/v3/users/84fa788ab3d84dc2ae333d817ad98651 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:48.927233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5e7d-b277-4cd1-bf4b-a9d7fcf6ed7f None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:48.943018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250c783-c76e-41d3-810f-cad83ce0309c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:48.943831 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c783-c76e-41d3-810f-cad83ce0309c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.944118 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c783-c76e-41d3-810f-cad83ce0309c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.944403 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c783-c76e-41d3-810f-cad83ce0309c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.955246 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250c783-c76e-41d3-810f-cad83ce0309c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-5250c783-c76e-41d3-810f-cad83ce0309c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:48.963302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:48.964135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:34:48.964890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 41/75] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:34:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:48.967788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb386e5-7221-4f55-b38c-246c8a8f7dd4 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:48.968137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb386e5-7221-4f55-b38c-246c8a8f7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:48.968424 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb386e5-7221-4f55-b38c-246c8a8f7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:48.985007 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-bbb386e5-7221-4f55-b38c-246c8a8f7dd4 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:48.986396 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-bbb386e5-7221-4f55-b38c-246c8a8f7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:49.015522 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.033931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.034815 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5e7d-b277-4cd1-bf4b-a9d7fcf6ed7f None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.056240 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 42/76] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:49.057509 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c809fa-9b36-4944-82f7-f9560f41096f None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.057799 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c809fa-9b36-4944-82f7-f9560f41096f None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.058085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c809fa-9b36-4944-82f7-f9560f41096f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.068507 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a775766-0fa8-4498-874d-94a7857c7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:49.069396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a775766-0fa8-4498-874d-94a7857c7d10 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.069688 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a775766-0fa8-4498-874d-94a7857c7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.069957 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a775766-0fa8-4498-874d-94a7857c7d10 None admin] PATH_INFO: `/v3/users/5c76b07e47a84c48b4608f75eeee3a3e` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.071280 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a775766-0fa8-4498-874d-94a7857c7d10 None admin] RBAC: Authorizing `identity:get_user(user_id=5c76b07e47a84c48b4608f75eeee3a3e)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:49.072770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a775766-0fa8-4498-874d-94a7857c7d10 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:49.074549 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 35/77] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:48 2022] GET /identity/v3/users/5c76b07e47a84c48b4608f75eeee3a3e => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:49.079763 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a775766-0fa8-4498-874d-94a7857c7d10 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:49.080985 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-56c809fa-9b36-4944-82f7-f9560f41096f None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:49.082224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-56c809fa-9b36-4944-82f7-f9560f41096f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:49.150202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 43/78] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:49.151106 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c809fa-9b36-4944-82f7-f9560f41096f None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:49.181601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a775766-0fa8-4498-874d-94a7857c7d10 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.220575 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18b688-5edf-43d2-8f12-148c36a5671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:49.221283 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18b688-5edf-43d2-8f12-148c36a5671f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.221565 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18b688-5edf-43d2-8f12-148c36a5671f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.221830 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18b688-5edf-43d2-8f12-148c36a5671f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.241068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.260225 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c809fa-9b36-4944-82f7-f9560f41096f None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.271815 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.296657 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18b688-5edf-43d2-8f12-148c36a5671f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:49.296994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67896fb-3021-4d6c-b257-f446ac24e520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:49.297672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67896fb-3021-4d6c-b257-f446ac24e520 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.298150 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67896fb-3021-4d6c-b257-f446ac24e520 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.298239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18b688-5edf-43d2-8f12-148c36a5671f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:49.298497 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67896fb-3021-4d6c-b257-f446ac24e520 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.299249 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67896fb-3021-4d6c-b257-f446ac24e520 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:49.299560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67896fb-3021-4d6c-b257-f446ac24e520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:49.300969 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67896fb-3021-4d6c-b257-f446ac24e520 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:49.308898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 44/79] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:34:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:49.309861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67896fb-3021-4d6c-b257-f446ac24e520 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:49.399554 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 36/80] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:34:49.400427 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18b688-5edf-43d2-8f12-148c36a5671f None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:49.419985 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67896fb-3021-4d6c-b257-f446ac24e520 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.449522 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.453760 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf363fa-74ad-4b72-925d-ae470080049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:49.454483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf363fa-74ad-4b72-925d-ae470080049a None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.455001 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf363fa-74ad-4b72-925d-ae470080049a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.455195 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf363fa-74ad-4b72-925d-ae470080049a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.496266 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.500628 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18b688-5edf-43d2-8f12-148c36a5671f None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.523008 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf363fa-74ad-4b72-925d-ae470080049a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:49.524393 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf363fa-74ad-4b72-925d-ae470080049a None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:49.535596 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899cd3f-daf1-4067-add6-8b3d15959567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:49.536413 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899cd3f-daf1-4067-add6-8b3d15959567 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.536701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899cd3f-daf1-4067-add6-8b3d15959567 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.536983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899cd3f-daf1-4067-add6-8b3d15959567 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.538182 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899cd3f-daf1-4067-add6-8b3d15959567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:49.539715 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899cd3f-daf1-4067-add6-8b3d15959567 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:49.541631 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 37/81] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:49.542177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899cd3f-daf1-4067-add6-8b3d15959567 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:49.643088 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 45/82] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:34:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:34:49.643953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf363fa-74ad-4b72-925d-ae470080049a None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:49.644489 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899cd3f-daf1-4067-add6-8b3d15959567 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.661883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.678974 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc7e32-2886-4deb-a5d4-ebd8afef4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:49.679784 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc7e32-2886-4deb-a5d4-ebd8afef4196 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.680072 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc7e32-2886-4deb-a5d4-ebd8afef4196 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.680352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc7e32-2886-4deb-a5d4-ebd8afef4196 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.690772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc7e32-2886-4deb-a5d4-ebd8afef4196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-6bcc7e32-2886-4deb-a5d4-ebd8afef4196 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:49.698399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:49.699252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:34:49.699988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 38/83] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:49.700611 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc7e32-2886-4deb-a5d4-ebd8afef4196 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:49.717583 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.747883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf363fa-74ad-4b72-925d-ae470080049a None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.782491 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c434c7-9508-4104-9eb9-230ef63850cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:49.783316 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c434c7-9508-4104-9eb9-230ef63850cb None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.783606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c434c7-9508-4104-9eb9-230ef63850cb None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.783888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c434c7-9508-4104-9eb9-230ef63850cb None admin] PATH_INFO: `/v3/users/84fa788ab3d84dc2ae333d817ad98651` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.785096 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c434c7-9508-4104-9eb9-230ef63850cb None admin] RBAC: Authorizing `identity:get_user(user_id=84fa788ab3d84dc2ae333d817ad98651)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:49.786603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c434c7-9508-4104-9eb9-230ef63850cb None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:49.788247 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 46/84] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:49 2022] GET /identity/v3/users/84fa788ab3d84dc2ae333d817ad98651 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:49.789002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c434c7-9508-4104-9eb9-230ef63850cb None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:49.807617 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc7e32-2886-4deb-a5d4-ebd8afef4196 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.848251 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059b97-ff89-4364-b358-1159e0540309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:49.849125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059b97-ff89-4364-b358-1159e0540309 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.849415 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059b97-ff89-4364-b358-1159e0540309 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.849679 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20059b97-ff89-4364-b358-1159e0540309 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.850919 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059b97-ff89-4364-b358-1159e0540309 None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:49.852422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20059b97-ff89-4364-b358-1159e0540309 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:49.854180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 39/85] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:49 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:49.854991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059b97-ff89-4364-b358-1159e0540309 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:49.903712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c434c7-9508-4104-9eb9-230ef63850cb None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.914985 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.939425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2437ca4-4b71-4606-8e80-dd746631055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:49.940122 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2437ca4-4b71-4606-8e80-dd746631055e None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:49.940402 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2437ca4-4b71-4606-8e80-dd746631055e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:49.940685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2437ca4-4b71-4606-8e80-dd746631055e None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:49.941407 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2437ca4-4b71-4606-8e80-dd746631055e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:49.942928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2437ca4-4b71-4606-8e80-dd746631055e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:49.958137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:49.970695 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 47/86] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:34:49 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:34:49.972341 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20059b97-ff89-4364-b358-1159e0540309 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:49.976412 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2437ca4-4b71-4606-8e80-dd746631055e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:50.016277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca09f0-622d-4a1c-ab12-a1064ce7329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:50.017283 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca09f0-622d-4a1c-ab12-a1064ce7329f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:50.017649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca09f0-622d-4a1c-ab12-a1064ce7329f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:50.017987 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ca09f0-622d-4a1c-ab12-a1064ce7329f None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:50.019338 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca09f0-622d-4a1c-ab12-a1064ce7329f None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:50.021538 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ca09f0-622d-4a1c-ab12-a1064ce7329f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:50.029336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 40/87] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:49 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:50.029336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca09f0-622d-4a1c-ab12-a1064ce7329f None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:50.087540 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2437ca4-4b71-4606-8e80-dd746631055e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:50.124294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab00e0-0543-457a-b2ae-ad3787c5efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:50.125000 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab00e0-0543-457a-b2ae-ad3787c5efd6 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:50.125292 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab00e0-0543-457a-b2ae-ad3787c5efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:50.125567 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab00e0-0543-457a-b2ae-ad3787c5efd6 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:50.126640 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab00e0-0543-457a-b2ae-ad3787c5efd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:50.127054 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab00e0-0543-457a-b2ae-ad3787c5efd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:50.128534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab00e0-0543-457a-b2ae-ad3787c5efd6 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:50.137499 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 48/88] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:50.139549 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab00e0-0543-457a-b2ae-ad3787c5efd6 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:50.155089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ca09f0-622d-4a1c-ab12-a1064ce7329f None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:50.169854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:50.198014 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d100-db78-4228-885b-270cc81db8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:50.198761 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d100-db78-4228-885b-270cc81db8a2 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:50.199053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d100-db78-4228-885b-270cc81db8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:50.199341 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00d100-db78-4228-885b-270cc81db8a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:50.213974 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:50.267694 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab00e0-0543-457a-b2ae-ad3787c5efd6 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:50.291391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00d100-db78-4228-885b-270cc81db8a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:50.292896 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00d100-db78-4228-885b-270cc81db8a2 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:50.307391 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbbd9b-f6c4-469e-a587-185b2a621675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:50.308420 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbbd9b-f6c4-469e-a587-185b2a621675 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:50.308926 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbbd9b-f6c4-469e-a587-185b2a621675 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:50.309399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cbbd9b-f6c4-469e-a587-185b2a621675 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:50.310572 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbbd9b-f6c4-469e-a587-185b2a621675 None admin] RBAC: Adding query filter params (role.id=209cb6e49795432bb796352cec30474f, scope.project.id=848b8e76a38e4d9da24492efeec48f1a, user.id=84fa788ab3d84dc2ae333d817ad98651) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:50.311138 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbbd9b-f6c4-469e-a587-185b2a621675 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:50.312792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cbbd9b-f6c4-469e-a587-185b2a621675 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:50.322872 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 49/89] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:34:50 2022] GET /identity/v3/role_assignments?user.id=84fa788ab3d84dc2ae333d817ad98651&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=209cb6e49795432bb796352cec30474f => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:50.324059 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbbd9b-f6c4-469e-a587-185b2a621675 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:50.425659 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 41/90] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:34:50.426487 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d100-db78-4228-885b-270cc81db8a2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:50.451884 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cbbd9b-f6c4-469e-a587-185b2a621675 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:50.460870 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:50.477997 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:50.490483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3728c-3903-479d-a79f-16f953aca534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:50.491412 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3728c-3903-479d-a79f-16f953aca534 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:50.491699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3728c-3903-479d-a79f-16f953aca534 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:50.491981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3728c-3903-479d-a79f-16f953aca534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:50.492823 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3728c-3903-479d-a79f-16f953aca534 None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=848b8e76a38e4d9da24492efeec48f1a, user.id=5c76b07e47a84c48b4608f75eeee3a3e) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:50.493138 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3728c-3903-479d-a79f-16f953aca534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:50.494674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3728c-3903-479d-a79f-16f953aca534 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:50.506550 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 50/91] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:34:50 2022] GET /identity/v3/role_assignments?user.id=5c76b07e47a84c48b4608f75eeee3a3e&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=8e22816a513845d88f4934c2164a142b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:50.507607 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3728c-3903-479d-a79f-16f953aca534 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:50.693123 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00d100-db78-4228-885b-270cc81db8a2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:50.748514 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3728c-3903-479d-a79f-16f953aca534 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:50.773110 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56b6e-9bfb-4500-bda2-a1c99e41bdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:50.774369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56b6e-9bfb-4500-bda2-a1c99e41bdac None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:50.774885 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56b6e-9bfb-4500-bda2-a1c99e41bdac None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:50.775359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56b6e-9bfb-4500-bda2-a1c99e41bdac None admin] PATH_INFO: `/v3/users/84fa788ab3d84dc2ae333d817ad98651` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:50.783421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e56b6e-9bfb-4500-bda2-a1c99e41bdac None admin] RBAC: Authorizing `identity:get_user(user_id=84fa788ab3d84dc2ae333d817ad98651)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:50.785286 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e56b6e-9bfb-4500-bda2-a1c99e41bdac None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:50.787326 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 42/92] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:50 2022] GET /identity/v3/users/84fa788ab3d84dc2ae333d817ad98651 => generated 275 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:50.793088 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56b6e-9bfb-4500-bda2-a1c99e41bdac None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:50.830671 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c108c81-591d-49fd-97ba-a55ca22d33b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:50.832702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c108c81-591d-49fd-97ba-a55ca22d33b0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:50.833405 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c108c81-591d-49fd-97ba-a55ca22d33b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:50.836758 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c108c81-591d-49fd-97ba-a55ca22d33b0 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:50.838445 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c108c81-591d-49fd-97ba-a55ca22d33b0 None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:50.840146 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c108c81-591d-49fd-97ba-a55ca22d33b0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:50.842279 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 51/93] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:50 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:50.849988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c108c81-591d-49fd-97ba-a55ca22d33b0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:50.950865 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:50.969421 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:50.987619 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56b6e-9bfb-4500-bda2-a1c99e41bdac None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:51.047440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c108c81-591d-49fd-97ba-a55ca22d33b0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:51.056311 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd6353-9e28-44d0-bcbb-a5ea35efc6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:51.057021 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd6353-9e28-44d0-bcbb-a5ea35efc6bb None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:51.057309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd6353-9e28-44d0-bcbb-a5ea35efc6bb None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:51.057585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd6353-9e28-44d0-bcbb-a5ea35efc6bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:51.143720 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264a5d8-4b5a-4f7f-a209-9ae709f9b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:51.144761 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264a5d8-4b5a-4f7f-a209-9ae709f9b18d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:51.145246 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264a5d8-4b5a-4f7f-a209-9ae709f9b18d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:51.145716 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264a5d8-4b5a-4f7f-a209-9ae709f9b18d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:51.146824 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264a5d8-4b5a-4f7f-a209-9ae709f9b18d None admin] RBAC: Adding query filter params (role.id=85d95bf96f68469397338d49ad9fd8fa, scope.project.id=848b8e76a38e4d9da24492efeec48f1a, user.id=84fa788ab3d84dc2ae333d817ad98651) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:51.147356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264a5d8-4b5a-4f7f-a209-9ae709f9b18d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:51.149047 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264a5d8-4b5a-4f7f-a209-9ae709f9b18d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:51.155974 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 52/94] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:34:50 2022] GET /identity/v3/role_assignments?user.id=84fa788ab3d84dc2ae333d817ad98651&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=85d95bf96f68469397338d49ad9fd8fa => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:51.211146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd6353-9e28-44d0-bcbb-a5ea35efc6bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:51.212701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd6353-9e28-44d0-bcbb-a5ea35efc6bb None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:51.321185 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:51.342159 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 43/95] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:34:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:34:51.348339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264a5d8-4b5a-4f7f-a209-9ae709f9b18d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:51.481353 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264a5d8-4b5a-4f7f-a209-9ae709f9b18d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:51.502178 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:51.531351 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84deec18-8c17-40f9-b13a-6da6c8459e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:51.532295 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deec18-8c17-40f9-b13a-6da6c8459e94 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:51.532588 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deec18-8c17-40f9-b13a-6da6c8459e94 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:51.532870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84deec18-8c17-40f9-b13a-6da6c8459e94 None admin] PATH_INFO: `/v3/projects/d9ee50c097484ab7ab8ed333a78a952e` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:51.534151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84deec18-8c17-40f9-b13a-6da6c8459e94 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee50c097484ab7ab8ed333a78a952e)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:51.535703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84deec18-8c17-40f9-b13a-6da6c8459e94 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:51.537440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 53/96] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:51 2022] GET /identity/v3/projects/d9ee50c097484ab7ab8ed333a78a952e => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:51.543538 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd6353-9e28-44d0-bcbb-a5ea35efc6bb None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:51.688742 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd6353-9e28-44d0-bcbb-a5ea35efc6bb None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:51.733204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab60e25-b02a-45a3-adec-1449e194ffd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:51.733806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab60e25-b02a-45a3-adec-1449e194ffd5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:51.734097 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab60e25-b02a-45a3-adec-1449e194ffd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:51.734381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab60e25-b02a-45a3-adec-1449e194ffd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:51.735284 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab60e25-b02a-45a3-adec-1449e194ffd5 None admin] RBAC: Adding query filter params (role.id=209cb6e49795432bb796352cec30474f, scope.project.id=d9ee50c097484ab7ab8ed333a78a952e, user.id=84fa788ab3d84dc2ae333d817ad98651) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:51.735607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab60e25-b02a-45a3-adec-1449e194ffd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:51.737252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab60e25-b02a-45a3-adec-1449e194ffd5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:51.746557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 44/97] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:34:51 2022] GET /identity/v3/role_assignments?user.id=84fa788ab3d84dc2ae333d817ad98651&scope.project.id=d9ee50c097484ab7ab8ed333a78a952e&role.id=209cb6e49795432bb796352cec30474f => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:53.030098 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe88346-3188-4cb5-a484-ca91ca28dd8c None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:53.030679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe88346-3188-4cb5-a484-ca91ca28dd8c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:53.030679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe88346-3188-4cb5-a484-ca91ca28dd8c None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:53.032201 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 54/98] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:53.048180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510792f4-5ff9-47dc-abd3-33103f1bd948 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:53.049026 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510792f4-5ff9-47dc-abd3-33103f1bd948 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:53.049493 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510792f4-5ff9-47dc-abd3-33103f1bd948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:53.070648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-510792f4-5ff9-47dc-abd3-33103f1bd948 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:53.072161 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-510792f4-5ff9-47dc-abd3-33103f1bd948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:53.133924 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:53.172847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 45/99] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:53.209186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe88346-3188-4cb5-a484-ca91ca28dd8c None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:53.368165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe88346-3188-4cb5-a484-ca91ca28dd8c None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:53.377099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10900d9-36c7-4b98-873d-a510dad37f1b None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:53.377663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10900d9-36c7-4b98-873d-a510dad37f1b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:53.378132 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10900d9-36c7-4b98-873d-a510dad37f1b None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:53.379714 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 46/100] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:34:53.396796 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e85707-842d-4dfa-a6da-482c18af8b10 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:53.397370 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e85707-842d-4dfa-a6da-482c18af8b10 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:53.397838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e85707-842d-4dfa-a6da-482c18af8b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:53.428990 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-48e85707-842d-4dfa-a6da-482c18af8b10 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:53.430540 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-48e85707-842d-4dfa-a6da-482c18af8b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:53.470843 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c459-4d72-4698-8618-1fbca3b4a668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:53.473980 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c459-4d72-4698-8618-1fbca3b4a668 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:53.474493 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c459-4d72-4698-8618-1fbca3b4a668 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:53.474955 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342c459-4d72-4698-8618-1fbca3b4a668 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:53.480608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342c459-4d72-4698-8618-1fbca3b4a668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:53.482300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342c459-4d72-4698-8618-1fbca3b4a668 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:53.484395 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 55/101] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:53.490082 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c459-4d72-4698-8618-1fbca3b4a668 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:53.587438 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:53.611800 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 47/102] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:53.613183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318253a-446e-4b7d-bf43-000872bed3e9 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:53.613481 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318253a-446e-4b7d-bf43-000872bed3e9 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:53.613767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318253a-446e-4b7d-bf43-000872bed3e9 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:53.615301 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 48/103] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:53.642736 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca644e8-5f63-4779-9bd4-c7209c428ee7 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:53.643039 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca644e8-5f63-4779-9bd4-c7209c428ee7 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:53.643319 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca644e8-5f63-4779-9bd4-c7209c428ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:53.650551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342c459-4d72-4698-8618-1fbca3b4a668 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:53.695488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-1ca644e8-5f63-4779-9bd4-c7209c428ee7 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:53.696719 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-1ca644e8-5f63-4779-9bd4-c7209c428ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:53.701679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5c3b2-683b-4fc7-9b3c-5781ea9a9af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:53.702359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c3b2-683b-4fc7-9b3c-5781ea9a9af4 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:53.702673 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c3b2-683b-4fc7-9b3c-5781ea9a9af4 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:53.702954 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5c3b2-683b-4fc7-9b3c-5781ea9a9af4 None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:53.703861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5c3b2-683b-4fc7-9b3c-5781ea9a9af4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:53.705690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5c3b2-683b-4fc7-9b3c-5781ea9a9af4 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:53.743478 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 56/104] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:34:53 2022] POST /identity/v3/projects => generated 302 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:34:53.744423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5c3b2-683b-4fc7-9b3c-5781ea9a9af4 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:53.853666 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 49/105] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:53.894657 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca644e8-5f63-4779-9bd4-c7209c428ee7 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:53.943637 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5c3b2-683b-4fc7-9b3c-5781ea9a9af4 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:53.961153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:53.970885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:54.002750 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e06f64-5dda-4700-8daf-fa5869f15f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.003554 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e06f64-5dda-4700-8daf-fa5869f15f0d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.003899 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e06f64-5dda-4700-8daf-fa5869f15f0d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.004192 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e06f64-5dda-4700-8daf-fa5869f15f0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.023745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e06f64-5dda-4700-8daf-fa5869f15f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-c0e06f64-5dda-4700-8daf-fa5869f15f0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:54.039960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:54.041363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:34:54.042125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 57/106] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:54.049621 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e06f64-5dda-4700-8daf-fa5869f15f0d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:54.103835 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca644e8-5f63-4779-9bd4-c7209c428ee7 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:54.172253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e597ab-4b4a-4ee0-86cc-d5c7f554785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.175031 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e597ab-4b4a-4ee0-86cc-d5c7f554785c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.175327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e597ab-4b4a-4ee0-86cc-d5c7f554785c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.175608 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e597ab-4b4a-4ee0-86cc-d5c7f554785c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.198249 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e597ab-4b4a-4ee0-86cc-d5c7f554785c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-b6e597ab-4b4a-4ee0-86cc-d5c7f554785c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:54.208690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:54.209582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:34:54.210352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:34:54.212826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 50/107] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:54.218511 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e597ab-4b4a-4ee0-86cc-d5c7f554785c None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:54.254171 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e06f64-5dda-4700-8daf-fa5869f15f0d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:54.291200 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ff469-7582-4f2c-ab15-8cbcb0c1cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.292257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ff469-7582-4f2c-ab15-8cbcb0c1cf36 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.292779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ff469-7582-4f2c-ab15-8cbcb0c1cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.293262 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ff469-7582-4f2c-ab15-8cbcb0c1cf36 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.294219 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ff469-7582-4f2c-ab15-8cbcb0c1cf36 None admin] RBAC: Adding query filter params (name=member) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:54.294754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ff469-7582-4f2c-ab15-8cbcb0c1cf36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:54.296354 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ff469-7582-4f2c-ab15-8cbcb0c1cf36 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:54.310558 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 58/108] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:34:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:34:54.312263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d700-4e7f-487a-8696-36b3416633c9 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.312764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d700-4e7f-487a-8696-36b3416633c9 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.313295 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d097d700-4e7f-487a-8696-36b3416633c9 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.315002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 59/109] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:54.319964 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d700-4e7f-487a-8696-36b3416633c9 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:54.342711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:54.351215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e597ab-4b4a-4ee0-86cc-d5c7f554785c None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:54.386859 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:54.387358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad3e89-b9e1-476f-af5c-e609b635be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.389064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad3e89-b9e1-476f-af5c-e609b635be12 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.389537 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad3e89-b9e1-476f-af5c-e609b635be12 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.390022 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad3e89-b9e1-476f-af5c-e609b635be12 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.391119 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad3e89-b9e1-476f-af5c-e609b635be12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:54.392529 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad3e89-b9e1-476f-af5c-e609b635be12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:54.394222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad3e89-b9e1-476f-af5c-e609b635be12 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:54.404026 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 51/110] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:34:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:54.405782 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be8b4c-4a72-4ca3-8ad9-7cfd41c6e45c None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.406264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be8b4c-4a72-4ca3-8ad9-7cfd41c6e45c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.406862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be8b4c-4a72-4ca3-8ad9-7cfd41c6e45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.424956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-40be8b4c-4a72-4ca3-8ad9-7cfd41c6e45c None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:54.426582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-40be8b4c-4a72-4ca3-8ad9-7cfd41c6e45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:54.524657 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 52/111] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:54.525285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be8b4c-4a72-4ca3-8ad9-7cfd41c6e45c None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:54.548819 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d097d700-4e7f-487a-8696-36b3416633c9 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:54.607633 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10b482-07b8-4345-a018-6c99071f5b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.608936 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10b482-07b8-4345-a018-6c99071f5b75 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.609434 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10b482-07b8-4345-a018-6c99071f5b75 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.609889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10b482-07b8-4345-a018-6c99071f5b75 None admin] PATH_INFO: `/v3/users/84fa788ab3d84dc2ae333d817ad98651` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.612427 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10b482-07b8-4345-a018-6c99071f5b75 None admin] RBAC: Authorizing `identity:get_user(user_id=84fa788ab3d84dc2ae333d817ad98651)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:54.614662 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10b482-07b8-4345-a018-6c99071f5b75 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:54.617742 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 60/112] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:54 2022] GET /identity/v3/users/84fa788ab3d84dc2ae333d817ad98651 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:54.621033 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10b482-07b8-4345-a018-6c99071f5b75 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:54.684174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:54.713132 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be8b4c-4a72-4ca3-8ad9-7cfd41c6e45c None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:54.777777 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05ffc-7341-42f5-9093-7108c7848e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.778723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05ffc-7341-42f5-9093-7108c7848e99 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.779012 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05ffc-7341-42f5-9093-7108c7848e99 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.779297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05ffc-7341-42f5-9093-7108c7848e99 None admin] PATH_INFO: `/v3/users/dcc6e6c5bd2f4175998ec4edb25dcbde` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.789359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:54.795258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10b482-07b8-4345-a018-6c99071f5b75 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:54.801120 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05ffc-7341-42f5-9093-7108c7848e99 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc6e6c5bd2f4175998ec4edb25dcbde)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:54.802660 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05ffc-7341-42f5-9093-7108c7848e99 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:54.804930 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 53/113] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:54 2022] GET /identity/v3/users/dcc6e6c5bd2f4175998ec4edb25dcbde => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:54.805706 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05ffc-7341-42f5-9093-7108c7848e99 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:54.851184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc6b39-0554-4791-bd47-d6be02a1df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.851994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6b39-0554-4791-bd47-d6be02a1df80 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.852284 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6b39-0554-4791-bd47-d6be02a1df80 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.852565 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc6b39-0554-4791-bd47-d6be02a1df80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.867344 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc6b39-0554-4791-bd47-d6be02a1df80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-9ebc6b39-0554-4791-bd47-d6be02a1df80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:54.878717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:54.879593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:34:54.880326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 61/114] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:54.881778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef287-990f-4a42-9440-cfb6c308826a None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.881778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef287-990f-4a42-9440-cfb6c308826a None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.886528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef287-990f-4a42-9440-cfb6c308826a None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.886528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 62/115] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:54.886528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef287-990f-4a42-9440-cfb6c308826a None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:54.934778 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05ffc-7341-42f5-9093-7108c7848e99 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:54.973604 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d1438-71bb-47cf-9611-aa74e00cedd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:54.974909 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1438-71bb-47cf-9611-aa74e00cedd8 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.975408 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1438-71bb-47cf-9611-aa74e00cedd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.975870 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1438-71bb-47cf-9611-aa74e00cedd8 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:54.977331 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d1438-71bb-47cf-9611-aa74e00cedd8 None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:54.979210 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d1438-71bb-47cf-9611-aa74e00cedd8 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:54.981166 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 54/116] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:54 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:54.982553 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb059-0954-4fd0-a09e-016e458eb370 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:54.983059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb059-0954-4fd0-a09e-016e458eb370 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:54.983536 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fdb059-0954-4fd0-a09e-016e458eb370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.002571 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-c3fdb059-0954-4fd0-a09e-016e458eb370 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:55.004378 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-c3fdb059-0954-4fd0-a09e-016e458eb370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:55.013210 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:55.037641 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef287-990f-4a42-9440-cfb6c308826a None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:55.076981 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 55/117] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:55.078207 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb059-0954-4fd0-a09e-016e458eb370 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:55.082846 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63ae33-ad5d-41cc-8ebc-17bdc34676d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:55.083504 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63ae33-ad5d-41cc-8ebc-17bdc34676d0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.083789 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63ae33-ad5d-41cc-8ebc-17bdc34676d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.084067 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63ae33-ad5d-41cc-8ebc-17bdc34676d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.121636 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:55.173752 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63ae33-ad5d-41cc-8ebc-17bdc34676d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:55.175294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63ae33-ad5d-41cc-8ebc-17bdc34676d0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:55.188486 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fdb059-0954-4fd0-a09e-016e458eb370 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:55.225394 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779208db-1293-4c15-becc-15adff128702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:55.226065 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779208db-1293-4c15-becc-15adff128702 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.226354 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779208db-1293-4c15-becc-15adff128702 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.226689 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779208db-1293-4c15-becc-15adff128702 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.227564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779208db-1293-4c15-becc-15adff128702 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:55.227898 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779208db-1293-4c15-becc-15adff128702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:55.229335 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779208db-1293-4c15-becc-15adff128702 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:55.238677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 56/118] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:55.243686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779208db-1293-4c15-becc-15adff128702 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:55.247309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:55.279736 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 63/119] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:34:55.280606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63ae33-ad5d-41cc-8ebc-17bdc34676d0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:55.356379 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:55.374866 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779208db-1293-4c15-becc-15adff128702 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:55.417590 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63ae33-ad5d-41cc-8ebc-17bdc34676d0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:55.425578 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead8c7c-9637-484f-8a12-2d1c8a91c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:55.427209 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead8c7c-9637-484f-8a12-2d1c8a91c69f None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.427510 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead8c7c-9637-484f-8a12-2d1c8a91c69f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.427799 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead8c7c-9637-484f-8a12-2d1c8a91c69f None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a/users/84fa788ab3d84dc2ae333d817ad98651/roles/209cb6e49795432bb796352cec30474f` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.430295 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead8c7c-9637-484f-8a12-2d1c8a91c69f None admin] RBAC: Authorizing `identity:create_grant(project_id=848b8e76a38e4d9da24492efeec48f1a, user_id=84fa788ab3d84dc2ae333d817ad98651, role_id=209cb6e49795432bb796352cec30474f)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:55.432592 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead8c7c-9637-484f-8a12-2d1c8a91c69f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:55.462457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 57/120] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:34:55 2022] PUT /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a/users/84fa788ab3d84dc2ae333d817ad98651/roles/209cb6e49795432bb796352cec30474f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:34:55.462457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f65ce-c9b8-480f-a677-4561a961b0db None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.462457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f65ce-c9b8-480f-a677-4561a961b0db None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.462457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f65ce-c9b8-480f-a677-4561a961b0db None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.462457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 58/121] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:55.462457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f65ce-c9b8-480f-a677-4561a961b0db None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:55.473776 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf4dc8-3775-4650-8e77-7414b3304cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:55.474887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4dc8-3775-4650-8e77-7414b3304cef None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.475329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4dc8-3775-4650-8e77-7414b3304cef None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.475768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf4dc8-3775-4650-8e77-7414b3304cef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.510171 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf4dc8-3775-4650-8e77-7414b3304cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-8cbf4dc8-3775-4650-8e77-7414b3304cef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:55.531739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:55.532855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:34:55.533654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:34:55.538271 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 64/122] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:34:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:55.538271 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf4dc8-3775-4650-8e77-7414b3304cef None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:55.561855 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:55.612507 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f65ce-c9b8-480f-a677-4561a961b0db None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:55.650458 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ab53c-bcc8-4092-afaf-4923f796917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:55.651739 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ab53c-bcc8-4092-afaf-4923f796917e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.652239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ab53c-bcc8-4092-afaf-4923f796917e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.652805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ab53c-bcc8-4092-afaf-4923f796917e None admin] PATH_INFO: `/v3/users/5c76b07e47a84c48b4608f75eeee3a3e` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.655865 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ab53c-bcc8-4092-afaf-4923f796917e None admin] RBAC: Authorizing `identity:get_user(user_id=5c76b07e47a84c48b4608f75eeee3a3e)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:55.657839 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ab53c-bcc8-4092-afaf-4923f796917e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:55.659952 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 59/123] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:55 2022] GET /identity/v3/users/5c76b07e47a84c48b4608f75eeee3a3e => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:55.665981 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d5557-d3fe-4af0-9583-8df1795ef79c None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.666165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf4dc8-3775-4650-8e77-7414b3304cef None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:55.666693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d5557-d3fe-4af0-9583-8df1795ef79c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.667172 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d5557-d3fe-4af0-9583-8df1795ef79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.697869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:55.702051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-379d5557-d3fe-4af0-9583-8df1795ef79c None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:55.706317 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-379d5557-d3fe-4af0-9583-8df1795ef79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:55.733613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570beae-1ec8-48a2-8022-a979f7b9985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:55.734301 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570beae-1ec8-48a2-8022-a979f7b9985e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.734627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570beae-1ec8-48a2-8022-a979f7b9985e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.734911 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570beae-1ec8-48a2-8022-a979f7b9985e None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.739190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570beae-1ec8-48a2-8022-a979f7b9985e None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:55.741454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570beae-1ec8-48a2-8022-a979f7b9985e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:55.743456 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 65/124] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:55 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:55.747309 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570beae-1ec8-48a2-8022-a979f7b9985e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:55.814936 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 60/125] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:55.817324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d5557-d3fe-4af0-9583-8df1795ef79c None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:55.878931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570beae-1ec8-48a2-8022-a979f7b9985e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:55.902764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:55.915853 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa9f43-791b-4b9d-8422-9c3e0b0d4075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:55.916532 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa9f43-791b-4b9d-8422-9c3e0b0d4075 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.916931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa9f43-791b-4b9d-8422-9c3e0b0d4075 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.917225 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa9f43-791b-4b9d-8422-9c3e0b0d4075 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.917990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa9f43-791b-4b9d-8422-9c3e0b0d4075 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:55.918305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa9f43-791b-4b9d-8422-9c3e0b0d4075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:55.919873 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa9f43-791b-4b9d-8422-9c3e0b0d4075 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:55.929482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 66/126] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:34:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:55.930347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa9f43-791b-4b9d-8422-9c3e0b0d4075 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:55.950605 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d5557-d3fe-4af0-9583-8df1795ef79c None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:55.986723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ebcd6-af0e-432a-b166-81967d2ba0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:55.987079 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:55.988165 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ebcd6-af0e-432a-b166-81967d2ba0ec None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:55.988589 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ebcd6-af0e-432a-b166-81967d2ba0ec None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:55.988863 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ebcd6-af0e-432a-b166-81967d2ba0ec None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:55.990517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ebcd6-af0e-432a-b166-81967d2ba0ec None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:55.992166 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ebcd6-af0e-432a-b166-81967d2ba0ec None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:55.994257 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 61/127] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:55 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:55.999479 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ebcd6-af0e-432a-b166-81967d2ba0ec None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.040998 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa9f43-791b-4b9d-8422-9c3e0b0d4075 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.080872 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb543927-149c-4cc0-8104-31a7ed04eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.081871 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb543927-149c-4cc0-8104-31a7ed04eb00 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.082449 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb543927-149c-4cc0-8104-31a7ed04eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.082962 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb543927-149c-4cc0-8104-31a7ed04eb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.084520 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb543927-149c-4cc0-8104-31a7ed04eb00 None admin] RBAC: Adding query filter params (role.id=a6ec97dc5f284af19eeca47e8f257622, scope.project.id=848b8e76a38e4d9da24492efeec48f1a, user.id=dcc6e6c5bd2f4175998ec4edb25dcbde) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:56.085084 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb543927-149c-4cc0-8104-31a7ed04eb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:56.087735 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb543927-149c-4cc0-8104-31a7ed04eb00 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:56.095981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 67/128] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:34:55 2022] GET /identity/v3/role_assignments?user.id=dcc6e6c5bd2f4175998ec4edb25dcbde&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=a6ec97dc5f284af19eeca47e8f257622 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:56.097201 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb543927-149c-4cc0-8104-31a7ed04eb00 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.120039 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ebcd6-af0e-432a-b166-81967d2ba0ec None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.215917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb543927-149c-4cc0-8104-31a7ed04eb00 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.230803 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:56.242018 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:56.259173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895e90a-2369-4d98-b802-9ed44cf045ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.260723 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e90a-2369-4d98-b802-9ed44cf045ad None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.261427 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e90a-2369-4d98-b802-9ed44cf045ad None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.262124 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e90a-2369-4d98-b802-9ed44cf045ad None admin] PATH_INFO: `/v3/users/84fa788ab3d84dc2ae333d817ad98651` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.263914 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895e90a-2369-4d98-b802-9ed44cf045ad None admin] RBAC: Authorizing `identity:get_user(user_id=84fa788ab3d84dc2ae333d817ad98651)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:56.265604 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895e90a-2369-4d98-b802-9ed44cf045ad None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:56.267953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 68/129] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:56 2022] GET /identity/v3/users/84fa788ab3d84dc2ae333d817ad98651 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:56.269100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895e90a-2369-4d98-b802-9ed44cf045ad None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.279350 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a8198-1448-435d-b710-53e57a41f46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.280038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a8198-1448-435d-b710-53e57a41f46d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.280326 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a8198-1448-435d-b710-53e57a41f46d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.280602 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a8198-1448-435d-b710-53e57a41f46d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.332002 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a8198-1448-435d-b710-53e57a41f46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-9a5a8198-1448-435d-b710-53e57a41f46d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:56.347811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:56.348766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 62/130] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:56.349955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a8198-1448-435d-b710-53e57a41f46d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.420218 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895e90a-2369-4d98-b802-9ed44cf045ad None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.459929 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853dc97-49ce-4ec5-ad62-57053903c534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.461222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853dc97-49ce-4ec5-ad62-57053903c534 None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.461706 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853dc97-49ce-4ec5-ad62-57053903c534 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.462192 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853dc97-49ce-4ec5-ad62-57053903c534 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a/users/5c76b07e47a84c48b4608f75eeee3a3e/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.464443 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853dc97-49ce-4ec5-ad62-57053903c534 None admin] RBAC: Authorizing `identity:create_grant(project_id=848b8e76a38e4d9da24492efeec48f1a, user_id=5c76b07e47a84c48b4608f75eeee3a3e, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:56.466761 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853dc97-49ce-4ec5-ad62-57053903c534 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:56.485590 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 69/131] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:34:56 2022] PUT /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a/users/5c76b07e47a84c48b4608f75eeee3a3e/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:34:56.487479 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853dc97-49ce-4ec5-ad62-57053903c534 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.539334 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a8198-1448-435d-b710-53e57a41f46d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.582973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:56.608632 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c44b2f-4d6b-4167-a233-989caa9e5651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.610262 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44b2f-4d6b-4167-a233-989caa9e5651 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.611205 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44b2f-4d6b-4167-a233-989caa9e5651 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.611500 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c44b2f-4d6b-4167-a233-989caa9e5651 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.613856 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44b2f-4d6b-4167-a233-989caa9e5651 None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:56.615433 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c44b2f-4d6b-4167-a233-989caa9e5651 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:56.617210 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 63/132] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:56 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:56.621976 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf8fc-64aa-4424-abeb-f1bbc15ef28a None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.622194 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf8fc-64aa-4424-abeb-f1bbc15ef28a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.622457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cf8fc-64aa-4424-abeb-f1bbc15ef28a None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.628545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 64/133] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:56 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:56.629181 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf8fc-64aa-4424-abeb-f1bbc15ef28a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.737372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853dc97-49ce-4ec5-ad62-57053903c534 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.756187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:56.789546 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336fa03-0ce1-43c5-8fe8-699d174b154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.790597 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336fa03-0ce1-43c5-8fe8-699d174b154e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.790896 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336fa03-0ce1-43c5-8fe8-699d174b154e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.791634 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336fa03-0ce1-43c5-8fe8-699d174b154e None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.792655 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336fa03-0ce1-43c5-8fe8-699d174b154e None admin] RBAC: Adding query filter params (name=member) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:56.792975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336fa03-0ce1-43c5-8fe8-699d174b154e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:56.794661 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336fa03-0ce1-43c5-8fe8-699d174b154e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:56.804942 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 70/134] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:34:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:56.806225 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d027ce2-5079-49e8-aa6e-ee8162240ea5 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.806560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d027ce2-5079-49e8-aa6e-ee8162240ea5 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.806842 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d027ce2-5079-49e8-aa6e-ee8162240ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.826815 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-9d027ce2-5079-49e8-aa6e-ee8162240ea5 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:56.828017 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-9d027ce2-5079-49e8-aa6e-ee8162240ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:56.828878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cf8fc-64aa-4424-abeb-f1bbc15ef28a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:56.867846 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b4f2a-f48c-4ebd-920f-8d843b19c0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:56.868803 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b4f2a-f48c-4ebd-920f-8d843b19c0a2 None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:56.869096 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b4f2a-f48c-4ebd-920f-8d843b19c0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:56.869490 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28b4f2a-f48c-4ebd-920f-8d843b19c0a2 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a/users/84fa788ab3d84dc2ae333d817ad98651/roles/85d95bf96f68469397338d49ad9fd8fa` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:56.871885 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b4f2a-f48c-4ebd-920f-8d843b19c0a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=848b8e76a38e4d9da24492efeec48f1a, user_id=84fa788ab3d84dc2ae333d817ad98651, role_id=85d95bf96f68469397338d49ad9fd8fa)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:56.873596 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28b4f2a-f48c-4ebd-920f-8d843b19c0a2 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:56.892816 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 65/135] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:34:56 2022] PUT /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a/users/84fa788ab3d84dc2ae333d817ad98651/roles/85d95bf96f68469397338d49ad9fd8fa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:34:56.894573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b4f2a-f48c-4ebd-920f-8d843b19c0a2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:56.988767 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 71/136] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:57.033827 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d027ce2-5079-49e8-aa6e-ee8162240ea5 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:57.086935 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:57.090369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28b4f2a-f48c-4ebd-920f-8d843b19c0a2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.113482 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:57.141369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc9088-b06f-4d7a-a26d-07364c513cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.142728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc9088-b06f-4d7a-a26d-07364c513cd6 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.143252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc9088-b06f-4d7a-a26d-07364c513cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.143724 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc9088-b06f-4d7a-a26d-07364c513cd6 None admin] PATH_INFO: `/v3/users/84fa788ab3d84dc2ae333d817ad98651` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.146212 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc9088-b06f-4d7a-a26d-07364c513cd6 None admin] RBAC: Authorizing `identity:get_user(user_id=84fa788ab3d84dc2ae333d817ad98651)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.148022 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc9088-b06f-4d7a-a26d-07364c513cd6 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.156904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 66/137] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:56 2022] GET /identity/v3/users/84fa788ab3d84dc2ae333d817ad98651 => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:57.163057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc9088-b06f-4d7a-a26d-07364c513cd6 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:57.258565 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d027ce2-5079-49e8-aa6e-ee8162240ea5 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.302988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc9088-b06f-4d7a-a26d-07364c513cd6 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.306381 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b187c1-b171-40ae-9aae-fd69466a7f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.307244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b187c1-b171-40ae-9aae-fd69466a7f84 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.307537 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b187c1-b171-40ae-9aae-fd69466a7f84 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.307820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b187c1-b171-40ae-9aae-fd69466a7f84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.309031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b187c1-b171-40ae-9aae-fd69466a7f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.310557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b187c1-b171-40ae-9aae-fd69466a7f84 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.314449 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 72/138] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:57.320740 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b187c1-b171-40ae-9aae-fd69466a7f84 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:57.350092 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314cf2f-aaa4-46a2-b086-dfbeee7440a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.351360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314cf2f-aaa4-46a2-b086-dfbeee7440a0 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.351844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314cf2f-aaa4-46a2-b086-dfbeee7440a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.352578 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314cf2f-aaa4-46a2-b086-dfbeee7440a0 None admin] PATH_INFO: `/v3/projects/d9ee50c097484ab7ab8ed333a78a952e` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.354034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314cf2f-aaa4-46a2-b086-dfbeee7440a0 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee50c097484ab7ab8ed333a78a952e)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.356049 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314cf2f-aaa4-46a2-b086-dfbeee7440a0 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.357983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 67/139] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:57 2022] GET /identity/v3/projects/d9ee50c097484ab7ab8ed333a78a952e => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:57.366057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314cf2f-aaa4-46a2-b086-dfbeee7440a0 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:57.436683 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:57.441319 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b187c1-b171-40ae-9aae-fd69466a7f84 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.457320 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:57.498085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78cd2d-3147-420e-997b-f237fd17597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.499040 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78cd2d-3147-420e-997b-f237fd17597d None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.499569 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78cd2d-3147-420e-997b-f237fd17597d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.499988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78cd2d-3147-420e-997b-f237fd17597d None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.501753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78cd2d-3147-420e-997b-f237fd17597d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.503475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78cd2d-3147-420e-997b-f237fd17597d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.528614 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314cf2f-aaa4-46a2-b086-dfbeee7440a0 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:57.536968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 73/140] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:34:57 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:34:57.583407 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1c1df-94bf-41e9-857f-86d5f9b6de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:57.584874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1c1df-94bf-41e9-857f-86d5f9b6de60 None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:57.585352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1c1df-94bf-41e9-857f-86d5f9b6de60 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:57.585864 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1c1df-94bf-41e9-857f-86d5f9b6de60 None admin] PATH_INFO: `/v3/projects/d9ee50c097484ab7ab8ed333a78a952e/users/84fa788ab3d84dc2ae333d817ad98651/roles/209cb6e49795432bb796352cec30474f` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:57.591545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1c1df-94bf-41e9-857f-86d5f9b6de60 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9ee50c097484ab7ab8ed333a78a952e, user_id=84fa788ab3d84dc2ae333d817ad98651, role_id=209cb6e49795432bb796352cec30474f)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:57.593332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1c1df-94bf-41e9-857f-86d5f9b6de60 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:57.620017 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 68/141] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:34:57 2022] PUT /identity/v3/projects/d9ee50c097484ab7ab8ed333a78a952e/users/84fa788ab3d84dc2ae333d817ad98651/roles/209cb6e49795432bb796352cec30474f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:34:58.440368 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d09dc-bb6a-4503-9a3f-0ad3528052c5 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:58.441229 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d09dc-bb6a-4503-9a3f-0ad3528052c5 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:58.441733 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d09dc-bb6a-4503-9a3f-0ad3528052c5 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:58.443361 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 74/142] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:34:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:34:58.456047 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debd1dc-79bf-48d3-b8e1-54c99b74cc8a None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:58.456918 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debd1dc-79bf-48d3-b8e1-54c99b74cc8a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:58.457399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debd1dc-79bf-48d3-b8e1-54c99b74cc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:58.481758 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-5debd1dc-79bf-48d3-b8e1-54c99b74cc8a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:34:58.483347 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-5debd1dc-79bf-48d3-b8e1-54c99b74cc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:34:58.559744 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 69/143] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:34:58.604917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d09dc-bb6a-4503-9a3f-0ad3528052c5 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:58.742769 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d09dc-bb6a-4503-9a3f-0ad3528052c5 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:58.784374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60afad-6de3-407c-9d19-03754e8c2b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:58.785579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60afad-6de3-407c-9d19-03754e8c2b01 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:58.786070 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60afad-6de3-407c-9d19-03754e8c2b01 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:58.786602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60afad-6de3-407c-9d19-03754e8c2b01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:58.797939 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60afad-6de3-407c-9d19-03754e8c2b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-ec60afad-6de3-407c-9d19-03754e8c2b01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:34:58.806374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:34:58.807257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:34:58.808092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:34:58.810808 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 75/144] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:34:58.819790 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debd1dc-79bf-48d3-b8e1-54c99b74cc8a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:58.874636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:58.948875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debd1dc-79bf-48d3-b8e1-54c99b74cc8a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:59.008384 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d0842-a6da-41ae-8294-63e94709ae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:59.008980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d0842-a6da-41ae-8294-63e94709ae27 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:59.009285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d0842-a6da-41ae-8294-63e94709ae27 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:59.009568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d0842-a6da-41ae-8294-63e94709ae27 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:59.010335 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d0842-a6da-41ae-8294-63e94709ae27 None admin] RBAC: Adding query filter params (name=member) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:59.010683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d0842-a6da-41ae-8294-63e94709ae27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:59.012116 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d0842-a6da-41ae-8294-63e94709ae27 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:59.026623 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 70/145] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:34:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:59.031895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60afad-6de3-407c-9d19-03754e8c2b01 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:59.050282 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:59.165884 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60afad-6de3-407c-9d19-03754e8c2b01 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:59.212270 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed2cd-e94b-4535-88f1-10343217690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:59.213166 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed2cd-e94b-4535-88f1-10343217690a None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:59.213457 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed2cd-e94b-4535-88f1-10343217690a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:59.213740 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed2cd-e94b-4535-88f1-10343217690a None admin] PATH_INFO: `/v3/users/84fa788ab3d84dc2ae333d817ad98651` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:59.214994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aed2cd-e94b-4535-88f1-10343217690a None admin] RBAC: Authorizing `identity:get_user(user_id=84fa788ab3d84dc2ae333d817ad98651)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:59.216468 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aed2cd-e94b-4535-88f1-10343217690a None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:59.218135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 76/146] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:34:59 2022] GET /identity/v3/users/84fa788ab3d84dc2ae333d817ad98651 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:59.224464 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d0842-a6da-41ae-8294-63e94709ae27 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:59.337819 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d0842-a6da-41ae-8294-63e94709ae27 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:59.350264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:59.385238 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23741930-fd91-4f8c-9b3d-7d8c9c9d7f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:59.385904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23741930-fd91-4f8c-9b3d-7d8c9c9d7f1a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:59.386195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23741930-fd91-4f8c-9b3d-7d8c9c9d7f1a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:59.386508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23741930-fd91-4f8c-9b3d-7d8c9c9d7f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:59.459045 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23741930-fd91-4f8c-9b3d-7d8c9c9d7f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:59.460545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23741930-fd91-4f8c-9b3d-7d8c9c9d7f1a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:59.573191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 71/147] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:34:59.579615 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed2cd-e94b-4535-88f1-10343217690a None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:59.676065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:59.705907 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed2cd-e94b-4535-88f1-10343217690a None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:59.753197 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b9f377-e0d6-425b-92e3-fba5fda13a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:59.754117 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9f377-e0d6-425b-92e3-fba5fda13a75 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:59.754409 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9f377-e0d6-425b-92e3-fba5fda13a75 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:59.754716 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b9f377-e0d6-425b-92e3-fba5fda13a75 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:59.756017 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9f377-e0d6-425b-92e3-fba5fda13a75 None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:59.757499 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b9f377-e0d6-425b-92e3-fba5fda13a75 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:59.759578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 77/148] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:34:59 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:34:59.765292 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23741930-fd91-4f8c-9b3d-7d8c9c9d7f1a None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:34:59.779242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:34:59.896230 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23741930-fd91-4f8c-9b3d-7d8c9c9d7f1a None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:34:59.940956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4572b5-83bb-421b-ade1-87e56f188c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:34:59.941652 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4572b5-83bb-421b-ade1-87e56f188c79 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:34:59.941943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4572b5-83bb-421b-ade1-87e56f188c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:34:59.942226 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4572b5-83bb-421b-ade1-87e56f188c79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:34:59.943184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4572b5-83bb-421b-ade1-87e56f188c79 None admin] RBAC: Adding query filter params (role.id=209cb6e49795432bb796352cec30474f, scope.project.id=848b8e76a38e4d9da24492efeec48f1a, user.id=84fa788ab3d84dc2ae333d817ad98651) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:34:59.943508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4572b5-83bb-421b-ade1-87e56f188c79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:34:59.945172 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4572b5-83bb-421b-ade1-87e56f188c79 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:34:59.951821 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 72/149] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:34:59 2022] GET /identity/v3/role_assignments?user.id=84fa788ab3d84dc2ae333d817ad98651&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=209cb6e49795432bb796352cec30474f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:00.059787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643d7f6-202b-4177-9d37-184c3d35a912 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.060053 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643d7f6-202b-4177-9d37-184c3d35a912 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.060348 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643d7f6-202b-4177-9d37-184c3d35a912 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.061740 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 78/150] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:00.080588 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40fe59-b1a4-484e-a3fc-458358aed273 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.080877 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40fe59-b1a4-484e-a3fc-458358aed273 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.081159 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f40fe59-b1a4-484e-a3fc-458358aed273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.106795 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-4f40fe59-b1a4-484e-a3fc-458358aed273 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:00.108044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-4f40fe59-b1a4-484e-a3fc-458358aed273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:00.210907 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:00.216517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 73/151] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:00.264833 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643d7f6-202b-4177-9d37-184c3d35a912 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:00.289683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc066-7e34-4c99-b05a-aa3e5b983a7b None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.289996 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc066-7e34-4c99-b05a-aa3e5b983a7b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.290250 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bc066-7e34-4c99-b05a-aa3e5b983a7b None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.291686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 74/152] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:00.299223 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab74a-2e04-45e5-a03a-43f4cc614e9e None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.299521 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab74a-2e04-45e5-a03a-43f4cc614e9e None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.299822 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ab74a-2e04-45e5-a03a-43f4cc614e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.339973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-5f9ab74a-2e04-45e5-a03a-43f4cc614e9e None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:00.341187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-5f9ab74a-2e04-45e5-a03a-43f4cc614e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:00.459797 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 75/153] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:00.467780 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643d7f6-202b-4177-9d37-184c3d35a912 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:00.510945 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02d1d2-75f6-46eb-9e9f-a390ccf8bf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:00.513104 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ab74a-2e04-45e5-a03a-43f4cc614e9e None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:00.514240 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02d1d2-75f6-46eb-9e9f-a390ccf8bf74 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.514589 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02d1d2-75f6-46eb-9e9f-a390ccf8bf74 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.514878 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02d1d2-75f6-46eb-9e9f-a390ccf8bf74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.540367 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02d1d2-75f6-46eb-9e9f-a390ccf8bf74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-5c02d1d2-75f6-46eb-9e9f-a390ccf8bf74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:00.548947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:00.551016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:00.552861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:00.554306 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 79/154] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:00.558443 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02d1d2-75f6-46eb-9e9f-a390ccf8bf74 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:00.577539 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:00.676837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ab74a-2e04-45e5-a03a-43f4cc614e9e None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:00.742889 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:00.754440 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548520af-2652-46ff-8cf6-e24462c56fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:00.755267 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548520af-2652-46ff-8cf6-e24462c56fd5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.755655 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548520af-2652-46ff-8cf6-e24462c56fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.755880 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548520af-2652-46ff-8cf6-e24462c56fd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.781820 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548520af-2652-46ff-8cf6-e24462c56fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:00.792334 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02d1d2-75f6-46eb-9e9f-a390ccf8bf74 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-548520af-2652-46ff-8cf6-e24462c56fd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:00.798556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:00.800455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:00.802606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:00.806759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 76/155] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:00.812559 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548520af-2652-46ff-8cf6-e24462c56fd5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:00.866967 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff48cac-9647-4733-9487-1c21b5c6535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:00.867651 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff48cac-9647-4733-9487-1c21b5c6535d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:00.867941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff48cac-9647-4733-9487-1c21b5c6535d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:00.868225 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff48cac-9647-4733-9487-1c21b5c6535d None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:00.868987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff48cac-9647-4733-9487-1c21b5c6535d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:00.869301 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff48cac-9647-4733-9487-1c21b5c6535d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:00.870734 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff48cac-9647-4733-9487-1c21b5c6535d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:00.894346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 80/156] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:00.899959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff48cac-9647-4733-9487-1c21b5c6535d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:00.977904 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:00.992765 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548520af-2652-46ff-8cf6-e24462c56fd5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.024705 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff48cac-9647-4733-9487-1c21b5c6535d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.053187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7fc5-985a-4695-a6d6-7bbb22285ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.053874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7fc5-985a-4695-a6d6-7bbb22285ded None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.054541 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7fc5-985a-4695-a6d6-7bbb22285ded None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.054541 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7fc5-985a-4695-a6d6-7bbb22285ded None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.055295 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7fc5-985a-4695-a6d6-7bbb22285ded None admin] RBAC: Adding query filter params (name=reader) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:01.055605 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7fc5-985a-4695-a6d6-7bbb22285ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.057029 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7fc5-985a-4695-a6d6-7bbb22285ded None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.074894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 77/157] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:01.080982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7fc5-985a-4695-a6d6-7bbb22285ded None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.082053 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba963fd-d158-48b8-b46b-b1541b6371d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.083296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba963fd-d158-48b8-b46b-b1541b6371d7 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.083913 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba963fd-d158-48b8-b46b-b1541b6371d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.084405 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba963fd-d158-48b8-b46b-b1541b6371d7 None admin] PATH_INFO: `/v3/users/5c76b07e47a84c48b4608f75eeee3a3e` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.086072 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba963fd-d158-48b8-b46b-b1541b6371d7 None admin] RBAC: Authorizing `identity:get_user(user_id=5c76b07e47a84c48b4608f75eeee3a3e)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.091414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba963fd-d158-48b8-b46b-b1541b6371d7 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.093625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 81/158] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:00 2022] GET /identity/v3/users/5c76b07e47a84c48b4608f75eeee3a3e => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:01.099643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba963fd-d158-48b8-b46b-b1541b6371d7 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.142362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:01.190086 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7fc5-985a-4695-a6d6-7bbb22285ded None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.230454 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9919e03-583f-4c16-9dd9-41b22886b8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.230454 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9919e03-583f-4c16-9dd9-41b22886b8e5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.230454 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9919e03-583f-4c16-9dd9-41b22886b8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.230454 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9919e03-583f-4c16-9dd9-41b22886b8e5 None admin] PATH_INFO: `/v3/users/dcc6e6c5bd2f4175998ec4edb25dcbde` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.230850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9919e03-583f-4c16-9dd9-41b22886b8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=dcc6e6c5bd2f4175998ec4edb25dcbde)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.230850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9919e03-583f-4c16-9dd9-41b22886b8e5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.231159 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 78/159] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:01 2022] GET /identity/v3/users/dcc6e6c5bd2f4175998ec4edb25dcbde => generated 289 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:01.236673 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9919e03-583f-4c16-9dd9-41b22886b8e5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.328670 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba963fd-d158-48b8-b46b-b1541b6371d7 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.385455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9919e03-583f-4c16-9dd9-41b22886b8e5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.421410 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:01.424319 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f6dd6-3f2d-4447-b0db-2ae9d9c42a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.424985 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6dd6-3f2d-4447-b0db-2ae9d9c42a7c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.425269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6dd6-3f2d-4447-b0db-2ae9d9c42a7c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.425548 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6dd6-3f2d-4447-b0db-2ae9d9c42a7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.455783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:01.462690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72bbf5-516d-4258-8a51-c56c076edd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.463578 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bbf5-516d-4258-8a51-c56c076edd73 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.463861 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bbf5-516d-4258-8a51-c56c076edd73 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.464140 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72bbf5-516d-4258-8a51-c56c076edd73 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.465674 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72bbf5-516d-4258-8a51-c56c076edd73 None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.467189 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72bbf5-516d-4258-8a51-c56c076edd73 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.474949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 79/160] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:01 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:01.476287 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299fad-ea35-4b33-af82-8840649309cf None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.476577 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299fad-ea35-4b33-af82-8840649309cf None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.476857 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1299fad-ea35-4b33-af82-8840649309cf None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.478399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 80/161] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:01.489327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299fad-ea35-4b33-af82-8840649309cf None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:01.674085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f6dd6-3f2d-4447-b0db-2ae9d9c42a7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.676206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f6dd6-3f2d-4447-b0db-2ae9d9c42a7c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.837291 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1299fad-ea35-4b33-af82-8840649309cf None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:01.923890 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06ff5c-80cd-4685-83d1-7ad660fa7446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:01.924869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06ff5c-80cd-4685-83d1-7ad660fa7446 None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.925097 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06ff5c-80cd-4685-83d1-7ad660fa7446 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.926697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06ff5c-80cd-4685-83d1-7ad660fa7446 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a/users/dcc6e6c5bd2f4175998ec4edb25dcbde/roles/a6ec97dc5f284af19eeca47e8f257622` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:01.927408 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06ff5c-80cd-4685-83d1-7ad660fa7446 None admin] RBAC: Authorizing `identity:create_grant(project_id=848b8e76a38e4d9da24492efeec48f1a, user_id=dcc6e6c5bd2f4175998ec4edb25dcbde, role_id=a6ec97dc5f284af19eeca47e8f257622)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:01.929000 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06ff5c-80cd-4685-83d1-7ad660fa7446 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:01.965727 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 81/162] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:01 2022] PUT /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a/users/dcc6e6c5bd2f4175998ec4edb25dcbde/roles/a6ec97dc5f284af19eeca47e8f257622 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:01.966881 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b741-7c14-4208-b37f-138e693ac6f8 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:01.967127 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b741-7c14-4208-b37f-138e693ac6f8 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:01.967410 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b741-7c14-4208-b37f-138e693ac6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.000135 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-6554b741-7c14-4208-b37f-138e693ac6f8 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:02.001397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-6554b741-7c14-4208-b37f-138e693ac6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:02.007451 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 82/163] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 908 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:35:02.013963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f6dd6-3f2d-4447-b0db-2ae9d9c42a7c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.092240 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:02.114990 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:02.183120 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 82/164] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:02.187030 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a798-f852-400f-adf1-988faf946c41 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.187323 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a798-f852-400f-adf1-988faf946c41 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.187602 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298a798-f852-400f-adf1-988faf946c41 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.189280 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 83/165] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:02.198882 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8b27e-cf5d-4a23-8c58-33546ace458e None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.199169 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8b27e-cf5d-4a23-8c58-33546ace458e None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.199430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8b27e-cf5d-4a23-8c58-33546ace458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.213049 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f6dd6-3f2d-4447-b0db-2ae9d9c42a7c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.243550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-f4d8b27e-cf5d-4a23-8c58-33546ace458e None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:02.244859 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-f4d8b27e-cf5d-4a23-8c58-33546ace458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:02.278362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f49ef6-497d-4b44-9ed8-31b1e4c05c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.281491 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49ef6-497d-4b44-9ed8-31b1e4c05c3a None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.282066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49ef6-497d-4b44-9ed8-31b1e4c05c3a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.282669 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f49ef6-497d-4b44-9ed8-31b1e4c05c3a None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.286518 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f49ef6-497d-4b44-9ed8-31b1e4c05c3a None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:02.288570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f49ef6-497d-4b44-9ed8-31b1e4c05c3a None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:02.292626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 83/166] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:02 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:02.295996 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f49ef6-497d-4b44-9ed8-31b1e4c05c3a None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.363979 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 84/167] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:02.365285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8b27e-cf5d-4a23-8c58-33546ace458e None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.434542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f49ef6-497d-4b44-9ed8-31b1e4c05c3a None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.446834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:02.485451 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f28f7-2cda-4ac3-bcde-5f58844b0a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.486765 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f28f7-2cda-4ac3-bcde-5f58844b0a2a None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.487152 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f28f7-2cda-4ac3-bcde-5f58844b0a2a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.487596 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f28f7-2cda-4ac3-bcde-5f58844b0a2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.498713 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f28f7-2cda-4ac3-bcde-5f58844b0a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:02.506471 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8b27e-cf5d-4a23-8c58-33546ace458e None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-3a7f28f7-2cda-4ac3-bcde-5f58844b0a2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:02.511602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:02.512821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:02.513791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:02.515427 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 84/168] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:02.516266 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f28f7-2cda-4ac3-bcde-5f58844b0a2a None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.523176 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:02.560750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636a1d0-c6e3-40f0-8f55-b4439bba499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.561433 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636a1d0-c6e3-40f0-8f55-b4439bba499f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.561723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636a1d0-c6e3-40f0-8f55-b4439bba499f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.562002 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636a1d0-c6e3-40f0-8f55-b4439bba499f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.563073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636a1d0-c6e3-40f0-8f55-b4439bba499f None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=848b8e76a38e4d9da24492efeec48f1a, user.id=5c76b07e47a84c48b4608f75eeee3a3e) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:02.563394 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636a1d0-c6e3-40f0-8f55-b4439bba499f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:02.565867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f636a1d0-c6e3-40f0-8f55-b4439bba499f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:02.573242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 85/169] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:02 2022] GET /identity/v3/role_assignments?user.id=5c76b07e47a84c48b4608f75eeee3a3e&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=8e22816a513845d88f4934c2164a142b => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:02.578023 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f6f35-aa46-4a48-9829-e51e791a89d0 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.578023 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f6f35-aa46-4a48-9829-e51e791a89d0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.578023 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080f6f35-aa46-4a48-9829-e51e791a89d0 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.578023 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 86/170] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:02.579043 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f6f35-aa46-4a48-9829-e51e791a89d0 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.661300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f28f7-2cda-4ac3-bcde-5f58844b0a2a None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.697977 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e756c4-0cb4-46e8-87fa-06252a4a4c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.698733 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e756c4-0cb4-46e8-87fa-06252a4a4c6f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.699023 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e756c4-0cb4-46e8-87fa-06252a4a4c6f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.699306 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e756c4-0cb4-46e8-87fa-06252a4a4c6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.701639 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080f6f35-aa46-4a48-9829-e51e791a89d0 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.710810 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e756c4-0cb4-46e8-87fa-06252a4a4c6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-f6e756c4-0cb4-46e8-87fa-06252a4a4c6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:02.719141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:02.720104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:02.720889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 85/171] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:02.722065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d293d2-efae-4a22-92d9-97c77efe9a4d None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.726576 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d293d2-efae-4a22-92d9-97c77efe9a4d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.726896 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d293d2-efae-4a22-92d9-97c77efe9a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.746703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-e0d293d2-efae-4a22-92d9-97c77efe9a4d None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:02.747853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05749d54-7b82-46a9-9174-9ad891dcdf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.747986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-e0d293d2-efae-4a22-92d9-97c77efe9a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:02.748806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05749d54-7b82-46a9-9174-9ad891dcdf03 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.749225 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05749d54-7b82-46a9-9174-9ad891dcdf03 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.749631 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05749d54-7b82-46a9-9174-9ad891dcdf03 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.750664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05749d54-7b82-46a9-9174-9ad891dcdf03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:02.751138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05749d54-7b82-46a9-9174-9ad891dcdf03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:02.752697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05749d54-7b82-46a9-9174-9ad891dcdf03 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:02.762510 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 87/172] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:02.763682 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05749d54-7b82-46a9-9174-9ad891dcdf03 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.787654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:02.802356 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:02.868069 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 86/173] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:02.868973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d293d2-efae-4a22-92d9-97c77efe9a4d None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.886451 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05749d54-7b82-46a9-9174-9ad891dcdf03 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:02.951648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa746b4-8e59-47c2-bc86-f6371c9af832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:02.953253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa746b4-8e59-47c2-bc86-f6371c9af832 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.953664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa746b4-8e59-47c2-bc86-f6371c9af832 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.954031 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa746b4-8e59-47c2-bc86-f6371c9af832 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.955089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa746b4-8e59-47c2-bc86-f6371c9af832 None admin] RBAC: Adding query filter params (name=member) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:02.955497 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa746b4-8e59-47c2-bc86-f6371c9af832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:02.957104 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa746b4-8e59-47c2-bc86-f6371c9af832 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:02.966300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 88/174] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:02.967703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03c487-387c-4a00-8f79-7fcd8eaf615a None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:02.968101 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03c487-387c-4a00-8f79-7fcd8eaf615a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:02.968474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f03c487-387c-4a00-8f79-7fcd8eaf615a None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:02.970995 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 89/175] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:02.971927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03c487-387c-4a00-8f79-7fcd8eaf615a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:02.998192 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d293d2-efae-4a22-92d9-97c77efe9a4d None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:03.052581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c578e60-d39e-4f50-af61-021a8ea09ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:03.053489 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c578e60-d39e-4f50-af61-021a8ea09ade None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.053772 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c578e60-d39e-4f50-af61-021a8ea09ade None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.054046 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c578e60-d39e-4f50-af61-021a8ea09ade None admin] PATH_INFO: `/v3/users/84fa788ab3d84dc2ae333d817ad98651` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.055583 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c578e60-d39e-4f50-af61-021a8ea09ade None admin] RBAC: Authorizing `identity:get_user(user_id=84fa788ab3d84dc2ae333d817ad98651)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:03.057251 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c578e60-d39e-4f50-af61-021a8ea09ade None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:03.059197 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 87/176] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:02 2022] GET /identity/v3/users/84fa788ab3d84dc2ae333d817ad98651 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:03.060604 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ba1c-fdb3-43a5-b07e-8ac594e38e27 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.060872 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ba1c-fdb3-43a5-b07e-8ac594e38e27 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.061507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7ba1c-fdb3-43a5-b07e-8ac594e38e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.090942 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-fad7ba1c-fdb3-43a5-b07e-8ac594e38e27 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:03.092535 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-fad7ba1c-fdb3-43a5-b07e-8ac594e38e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:03.119736 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:03.123469 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:03.138453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f03c487-387c-4a00-8f79-7fcd8eaf615a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:03.179896 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1abdcb-341f-4df2-af93-c283b0fb922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:03.181005 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1abdcb-341f-4df2-af93-c283b0fb922d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.181535 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1abdcb-341f-4df2-af93-c283b0fb922d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.181820 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1abdcb-341f-4df2-af93-c283b0fb922d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.187597 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 88/177] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:03.188417 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ba1c-fdb3-43a5-b07e-8ac594e38e27 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:03.205479 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1abdcb-341f-4df2-af93-c283b0fb922d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-0e1abdcb-341f-4df2-af93-c283b0fb922d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:03.217731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:03.219098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:03.219874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 90/178] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:03.220979 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1abdcb-341f-4df2-af93-c283b0fb922d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:03.324635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7ba1c-fdb3-43a5-b07e-8ac594e38e27 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:03.325076 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1abdcb-341f-4df2-af93-c283b0fb922d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:03.359918 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875bf17-7489-4188-b6af-b02a952fca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:03.361082 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875bf17-7489-4188-b6af-b02a952fca8c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.361370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875bf17-7489-4188-b6af-b02a952fca8c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.361649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875bf17-7489-4188-b6af-b02a952fca8c None admin] PATH_INFO: `/v3/users/84fa788ab3d84dc2ae333d817ad98651` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.362884 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875bf17-7489-4188-b6af-b02a952fca8c None admin] RBAC: Authorizing `identity:get_user(user_id=84fa788ab3d84dc2ae333d817ad98651)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:03.364359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875bf17-7489-4188-b6af-b02a952fca8c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:03.366165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 89/179] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:03 2022] GET /identity/v3/users/84fa788ab3d84dc2ae333d817ad98651 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:03.366881 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875bf17-7489-4188-b6af-b02a952fca8c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:03.368973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2ad33-26c9-4861-888a-7e0356517984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:03.369625 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2ad33-26c9-4861-888a-7e0356517984 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.369906 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2ad33-26c9-4861-888a-7e0356517984 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.370179 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2ad33-26c9-4861-888a-7e0356517984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.394857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:03.401673 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:03.458635 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2ad33-26c9-4861-888a-7e0356517984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:03.460041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2ad33-26c9-4861-888a-7e0356517984 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:03.481725 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875bf17-7489-4188-b6af-b02a952fca8c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:03.522274 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec455-3075-46b0-b38b-60c314518202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:03.523450 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec455-3075-46b0-b38b-60c314518202 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.523735 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec455-3075-46b0-b38b-60c314518202 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.524018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ec455-3075-46b0-b38b-60c314518202 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.536613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ec455-3075-46b0-b38b-60c314518202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-e44ec455-3075-46b0-b38b-60c314518202 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:03.544944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:03.545787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 90/180] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:03.552131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec455-3075-46b0-b38b-60c314518202 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:03.577479 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 91/181] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:03.579907 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00082b78-861a-4551-a5c4-5baa45e26a80 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.580202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00082b78-861a-4551-a5c4-5baa45e26a80 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.580520 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00082b78-861a-4551-a5c4-5baa45e26a80 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.582042 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 92/182] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:03.582771 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00082b78-861a-4551-a5c4-5baa45e26a80 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:03.645939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:03.651156 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:03.670778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ec455-3075-46b0-b38b-60c314518202 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:03.693036 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00082b78-861a-4551-a5c4-5baa45e26a80 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:03.707077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca868c92-3005-4a27-b55b-f0bf6214043d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:03.707656 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868c92-3005-4a27-b55b-f0bf6214043d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.707940 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868c92-3005-4a27-b55b-f0bf6214043d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.708212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca868c92-3005-4a27-b55b-f0bf6214043d None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.709042 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca868c92-3005-4a27-b55b-f0bf6214043d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:03.709282 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca868c92-3005-4a27-b55b-f0bf6214043d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:03.710751 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca868c92-3005-4a27-b55b-f0bf6214043d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:03.720009 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 91/183] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:03.720847 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca868c92-3005-4a27-b55b-f0bf6214043d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:03.737885 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5f057-69ca-468e-b79d-c00943c1a5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:03.739300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5f057-69ca-468e-b79d-c00943c1a5cf None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.739778 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5f057-69ca-468e-b79d-c00943c1a5cf None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.740264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5f057-69ca-468e-b79d-c00943c1a5cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.813145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5f057-69ca-468e-b79d-c00943c1a5cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:03.815034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5f057-69ca-468e-b79d-c00943c1a5cf None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:03.822392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca868c92-3005-4a27-b55b-f0bf6214043d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:03.856821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c1f0e-04bd-4fb0-beb3-e5a8ce743785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:03.857483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c1f0e-04bd-4fb0-beb3-e5a8ce743785 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.857765 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c1f0e-04bd-4fb0-beb3-e5a8ce743785 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.858035 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c1f0e-04bd-4fb0-beb3-e5a8ce743785 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.858803 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c1f0e-04bd-4fb0-beb3-e5a8ce743785 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:03.859109 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c1f0e-04bd-4fb0-beb3-e5a8ce743785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:03.860603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c1f0e-04bd-4fb0-beb3-e5a8ce743785 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:03.868540 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 92/184] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:03.871324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c1f0e-04bd-4fb0-beb3-e5a8ce743785 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:03.877165 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:03.882545 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:03.929636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 93/185] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:03.931983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7cfde-d2ca-4595-a23f-cf0ef3c2b25e None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:03.932545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7cfde-d2ca-4595-a23f-cf0ef3c2b25e None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:03.933018 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7cfde-d2ca-4595-a23f-cf0ef3c2b25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:03.950358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-31a7cfde-d2ca-4595-a23f-cf0ef3c2b25e None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:03.951583 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-31a7cfde-d2ca-4595-a23f-cf0ef3c2b25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:03.979562 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c1f0e-04bd-4fb0-beb3-e5a8ce743785 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.013135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913207d-cbb9-4899-a9c8-b40ab28d4b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.013983 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913207d-cbb9-4899-a9c8-b40ab28d4b48 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.014268 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913207d-cbb9-4899-a9c8-b40ab28d4b48 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.014578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913207d-cbb9-4899-a9c8-b40ab28d4b48 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.015758 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913207d-cbb9-4899-a9c8-b40ab28d4b48 None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.017277 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913207d-cbb9-4899-a9c8-b40ab28d4b48 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.018992 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 93/186] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:03 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.023963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913207d-cbb9-4899-a9c8-b40ab28d4b48 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.029341 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 94/187] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:04.030023 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7cfde-d2ca-4595-a23f-cf0ef3c2b25e None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.106817 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.121257 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.131555 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913207d-cbb9-4899-a9c8-b40ab28d4b48 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.138155 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7cfde-d2ca-4595-a23f-cf0ef3c2b25e None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.167736 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ea96-824a-4df5-a23b-05e903f6b8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.168616 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ea96-824a-4df5-a23b-05e903f6b8d0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.168897 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ea96-824a-4df5-a23b-05e903f6b8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.169241 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5ea96-824a-4df5-a23b-05e903f6b8d0 None admin] PATH_INFO: `/v3/users/87b7c39beda342cb9e815c5b71380531` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.173242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f699f-c8a3-4200-889c-c4875c61e8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.174130 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f699f-c8a3-4200-889c-c4875c61e8bc None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.174443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f699f-c8a3-4200-889c-c4875c61e8bc None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.174752 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f699f-c8a3-4200-889c-c4875c61e8bc None admin] PATH_INFO: `/v3/users/87b7c39beda342cb9e815c5b71380531` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.185598 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5ea96-824a-4df5-a23b-05e903f6b8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=87b7c39beda342cb9e815c5b71380531)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.187105 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb5ea96-824a-4df5-a23b-05e903f6b8d0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.189100 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f699f-c8a3-4200-889c-c4875c61e8bc None admin] RBAC: Authorizing `identity:get_user(user_id=87b7c39beda342cb9e815c5b71380531)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.189223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 94/188] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/users/87b7c39beda342cb9e815c5b71380531 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.190293 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f699f-c8a3-4200-889c-c4875c61e8bc None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.196325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 95/189] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/users/87b7c39beda342cb9e815c5b71380531 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.196325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f699f-c8a3-4200-889c-c4875c61e8bc None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.196610 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ea96-824a-4df5-a23b-05e903f6b8d0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.298533 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5ea96-824a-4df5-a23b-05e903f6b8d0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.298710 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f699f-c8a3-4200-889c-c4875c61e8bc None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.333356 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c0fee-69d7-4280-9068-6b9ef7d01f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.333586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070acf6a-3482-4ee4-9c3b-6326a8fbed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.334023 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c0fee-69d7-4280-9068-6b9ef7d01f2a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.334267 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070acf6a-3482-4ee4-9c3b-6326a8fbed48 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.334359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c0fee-69d7-4280-9068-6b9ef7d01f2a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.334600 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c0fee-69d7-4280-9068-6b9ef7d01f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.334690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070acf6a-3482-4ee4-9c3b-6326a8fbed48 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.334878 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070acf6a-3482-4ee4-9c3b-6326a8fbed48 None admin] PATH_INFO: `/v3/projects/d9ee50c097484ab7ab8ed333a78a952e` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.335430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c0fee-69d7-4280-9068-6b9ef7d01f2a None admin] RBAC: Adding query filter params (role.id=85d95bf96f68469397338d49ad9fd8fa, scope.project.id=848b8e76a38e4d9da24492efeec48f1a, user.id=84fa788ab3d84dc2ae333d817ad98651) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:04.335737 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c0fee-69d7-4280-9068-6b9ef7d01f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.336070 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070acf6a-3482-4ee4-9c3b-6326a8fbed48 None admin] RBAC: Authorizing `identity:get_project(project_id=d9ee50c097484ab7ab8ed333a78a952e)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.337191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c0fee-69d7-4280-9068-6b9ef7d01f2a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.337579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070acf6a-3482-4ee4-9c3b-6326a8fbed48 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.344481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 95/190] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/projects/d9ee50c097484ab7ab8ed333a78a952e => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.344481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070acf6a-3482-4ee4-9c3b-6326a8fbed48 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.344481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.358620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 96/191] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/role_assignments?user.id=84fa788ab3d84dc2ae333d817ad98651&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=85d95bf96f68469397338d49ad9fd8fa => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.358620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c0fee-69d7-4280-9068-6b9ef7d01f2a None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.371808 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.476366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c0fee-69d7-4280-9068-6b9ef7d01f2a None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.493633 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070acf6a-3482-4ee4-9c3b-6326a8fbed48 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.525004 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feda4c6-b1a8-4fbd-8565-4580e0ed5dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.526393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feda4c6-b1a8-4fbd-8565-4580e0ed5dd4 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.527204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feda4c6-b1a8-4fbd-8565-4580e0ed5dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.527682 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feda4c6-b1a8-4fbd-8565-4580e0ed5dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.533745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afc5d8-8f72-474c-8516-ab4a0ef99beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.534444 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afc5d8-8f72-474c-8516-ab4a0ef99beb None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.534752 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afc5d8-8f72-474c-8516-ab4a0ef99beb None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.535030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84afc5d8-8f72-474c-8516-ab4a0ef99beb None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.536232 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afc5d8-8f72-474c-8516-ab4a0ef99beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.537706 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84afc5d8-8f72-474c-8516-ab4a0ef99beb None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.544266 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 96/192] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.545497 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afc5d8-8f72-474c-8516-ab4a0ef99beb None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.626449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feda4c6-b1a8-4fbd-8565-4580e0ed5dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.628678 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feda4c6-b1a8-4fbd-8565-4580e0ed5dd4 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.640727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.642262 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.672985 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84afc5d8-8f72-474c-8516-ab4a0ef99beb None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.708944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1585f0-9733-45cd-aff7-43e6816cd92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.709595 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1585f0-9733-45cd-aff7-43e6816cd92e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.709875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1585f0-9733-45cd-aff7-43e6816cd92e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.710148 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1585f0-9733-45cd-aff7-43e6816cd92e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.754456 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 97/193] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:04.759804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feda4c6-b1a8-4fbd-8565-4580e0ed5dd4 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.780077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1585f0-9733-45cd-aff7-43e6816cd92e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.781586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1585f0-9733-45cd-aff7-43e6816cd92e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.856611 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.874401 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feda4c6-b1a8-4fbd-8565-4580e0ed5dd4 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:04.884887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:04.891882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 97/194] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:04.892706 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1585f0-9733-45cd-aff7-43e6816cd92e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:04.915964 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c6032-cce5-4e75-8075-35ff6cbb97de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:04.919395 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c6032-cce5-4e75-8075-35ff6cbb97de None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:04.919395 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c6032-cce5-4e75-8075-35ff6cbb97de None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:04.919395 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c6032-cce5-4e75-8075-35ff6cbb97de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:04.919395 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c6032-cce5-4e75-8075-35ff6cbb97de None admin] RBAC: Adding query filter params (role.id=209cb6e49795432bb796352cec30474f, scope.project.id=d9ee50c097484ab7ab8ed333a78a952e, user.id=84fa788ab3d84dc2ae333d817ad98651) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:04.919395 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c6032-cce5-4e75-8075-35ff6cbb97de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:04.920029 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c6032-cce5-4e75-8075-35ff6cbb97de None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:04.928679 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 98/195] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/role_assignments?user.id=84fa788ab3d84dc2ae333d817ad98651&scope.project.id=d9ee50c097484ab7ab8ed333a78a952e&role.id=209cb6e49795432bb796352cec30474f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:04.929128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c6032-cce5-4e75-8075-35ff6cbb97de None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:05.019643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1585f0-9733-45cd-aff7-43e6816cd92e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:05.047759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c6032-cce5-4e75-8075-35ff6cbb97de None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:05.058335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88ce8f-e295-43ed-a36a-a7418b0ec762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:05.059044 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88ce8f-e295-43ed-a36a-a7418b0ec762 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.059331 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88ce8f-e295-43ed-a36a-a7418b0ec762 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.059610 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88ce8f-e295-43ed-a36a-a7418b0ec762 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.060335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88ce8f-e295-43ed-a36a-a7418b0ec762 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:05.061822 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88ce8f-e295-43ed-a36a-a7418b0ec762 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:05.084442 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 98/196] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:04 2022] POST /identity/v3/users => generated 297 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:05.086620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35127bfe-66b0-495f-ab0a-f52f2bdefcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:05.087507 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35127bfe-66b0-495f-ab0a-f52f2bdefcbb None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.087798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35127bfe-66b0-495f-ab0a-f52f2bdefcbb None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.088085 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35127bfe-66b0-495f-ab0a-f52f2bdefcbb None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.089529 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35127bfe-66b0-495f-ab0a-f52f2bdefcbb None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:05.091228 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35127bfe-66b0-495f-ab0a-f52f2bdefcbb None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:05.093345 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 99/197] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:04 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:05.107420 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35127bfe-66b0-495f-ab0a-f52f2bdefcbb None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:05.107652 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23708e-a5ae-4c69-bf98-175b6f8875e7 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.107652 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23708e-a5ae-4c69-bf98-175b6f8875e7 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.107652 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23708e-a5ae-4c69-bf98-175b6f8875e7 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.107652 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 99/198] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:05.108821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23708e-a5ae-4c69-bf98-175b6f8875e7 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:05.154978 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:05.171892 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:05.253632 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35127bfe-66b0-495f-ab0a-f52f2bdefcbb None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:05.271557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23708e-a5ae-4c69-bf98-175b6f8875e7 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:05.296134 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a987b7-777c-4d2b-800d-0f046195165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:05.297051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a987b7-777c-4d2b-800d-0f046195165d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.297331 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a987b7-777c-4d2b-800d-0f046195165d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.297612 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a987b7-777c-4d2b-800d-0f046195165d None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.298867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a987b7-777c-4d2b-800d-0f046195165d None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:05.300345 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a987b7-777c-4d2b-800d-0f046195165d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:05.302169 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 100/199] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:05 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:05.307891 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d57a8e-7a55-4e7a-bcc0-14cb3b6f054a None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.308358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d57a8e-7a55-4e7a-bcc0-14cb3b6f054a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.308661 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d57a8e-7a55-4e7a-bcc0-14cb3b6f054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.310701 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc517e2-fe6d-4229-ac2e-a319a798ec6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:05.311368 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc517e2-fe6d-4229-ac2e-a319a798ec6f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.311666 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc517e2-fe6d-4229-ac2e-a319a798ec6f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.311949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc517e2-fe6d-4229-ac2e-a319a798ec6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.313713 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc517e2-fe6d-4229-ac2e-a319a798ec6f None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=36e5f01822474e888f237e6000a33a94, user.id=87b7c39beda342cb9e815c5b71380531) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:05.313713 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc517e2-fe6d-4229-ac2e-a319a798ec6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:05.314660 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc517e2-fe6d-4229-ac2e-a319a798ec6f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:05.322201 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 100/200] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:05 2022] GET /identity/v3/role_assignments?user.id=87b7c39beda342cb9e815c5b71380531&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=8e22816a513845d88f4934c2164a142b => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:05.323005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc517e2-fe6d-4229-ac2e-a319a798ec6f None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:05.327275 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-d2d57a8e-7a55-4e7a-bcc0-14cb3b6f054a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:05.328551 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-d2d57a8e-7a55-4e7a-bcc0-14cb3b6f054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:05.438259 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 101/201] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:05.445614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:05.458086 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc517e2-fe6d-4229-ac2e-a319a798ec6f None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:05.467448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d57a8e-7a55-4e7a-bcc0-14cb3b6f054a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:05.508119 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76811-470a-4ea7-9c49-dfe8a16a8666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:05.508820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76811-470a-4ea7-9c49-dfe8a16a8666 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.509110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76811-470a-4ea7-9c49-dfe8a16a8666 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.509387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea76811-470a-4ea7-9c49-dfe8a16a8666 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.510796 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76811-470a-4ea7-9c49-dfe8a16a8666 None admin] RBAC: Adding query filter params (role.id=85d95bf96f68469397338d49ad9fd8fa, scope.project.id=36e5f01822474e888f237e6000a33a94, user.id=87b7c39beda342cb9e815c5b71380531) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:05.511107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76811-470a-4ea7-9c49-dfe8a16a8666 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:05.512954 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea76811-470a-4ea7-9c49-dfe8a16a8666 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:05.522106 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 101/202] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:05 2022] GET /identity/v3/role_assignments?user.id=87b7c39beda342cb9e815c5b71380531&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=85d95bf96f68469397338d49ad9fd8fa => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:05.554836 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:05.608586 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d57a8e-7a55-4e7a-bcc0-14cb3b6f054a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:05.653918 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21550ee3-3f98-45fc-b47c-fc8c817c0101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:05.654783 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21550ee3-3f98-45fc-b47c-fc8c817c0101 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.655070 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21550ee3-3f98-45fc-b47c-fc8c817c0101 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.655349 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21550ee3-3f98-45fc-b47c-fc8c817c0101 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.668315 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21550ee3-3f98-45fc-b47c-fc8c817c0101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-21550ee3-3f98-45fc-b47c-fc8c817c0101 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:05.676573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:05.677508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:05.678279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 102/203] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:05.687607 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76811-470a-4ea7-9c49-dfe8a16a8666 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:05.842994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea76811-470a-4ea7-9c49-dfe8a16a8666 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:05.878640 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3933ce-4dfc-4518-a0eb-dceaa498914c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:05.879311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3933ce-4dfc-4518-a0eb-dceaa498914c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:05.879595 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3933ce-4dfc-4518-a0eb-dceaa498914c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:05.879873 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3933ce-4dfc-4518-a0eb-dceaa498914c None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:05.880625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3933ce-4dfc-4518-a0eb-dceaa498914c None admin] RBAC: Adding query filter params (name=reader) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:05.880931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3933ce-4dfc-4518-a0eb-dceaa498914c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:05.882339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3933ce-4dfc-4518-a0eb-dceaa498914c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:05.891606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 102/204] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:05.897169 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21550ee3-3f98-45fc-b47c-fc8c817c0101 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:06.039739 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:06.043934 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21550ee3-3f98-45fc-b47c-fc8c817c0101 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:06.091122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf539d0f-b4e2-4eb1-be05-745e314c3e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:06.092339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf539d0f-b4e2-4eb1-be05-745e314c3e0a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:06.092763 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf539d0f-b4e2-4eb1-be05-745e314c3e0a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:06.093237 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf539d0f-b4e2-4eb1-be05-745e314c3e0a None admin] PATH_INFO: `/v3/users/dcc6e6c5bd2f4175998ec4edb25dcbde` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:06.095228 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf539d0f-b4e2-4eb1-be05-745e314c3e0a None admin] RBAC: Authorizing `identity:get_user(user_id=dcc6e6c5bd2f4175998ec4edb25dcbde)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:06.096917 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf539d0f-b4e2-4eb1-be05-745e314c3e0a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:06.098883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 103/205] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:05 2022] GET /identity/v3/users/dcc6e6c5bd2f4175998ec4edb25dcbde => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:06.107549 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3933ce-4dfc-4518-a0eb-dceaa498914c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:06.145295 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:06.259542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3933ce-4dfc-4518-a0eb-dceaa498914c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:06.300099 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17ea58-ab2b-4b91-965f-6a8868989739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:06.300761 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17ea58-ab2b-4b91-965f-6a8868989739 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:06.301049 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17ea58-ab2b-4b91-965f-6a8868989739 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:06.301329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a17ea58-ab2b-4b91-965f-6a8868989739 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:06.385976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17ea58-ab2b-4b91-965f-6a8868989739 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:06.387399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a17ea58-ab2b-4b91-965f-6a8868989739 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:06.407770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:06.503345 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 103/206] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:06.508976 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf539d0f-b4e2-4eb1-be05-745e314c3e0a None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:06.651736 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf539d0f-b4e2-4eb1-be05-745e314c3e0a None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:06.712993 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1ae2c-116d-4f2f-a7e6-dc97e716df9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:06.714824 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1ae2c-116d-4f2f-a7e6-dc97e716df9f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:06.715337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1ae2c-116d-4f2f-a7e6-dc97e716df9f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:06.715813 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1ae2c-116d-4f2f-a7e6-dc97e716df9f None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:06.723464 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1ae2c-116d-4f2f-a7e6-dc97e716df9f None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:06.725357 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1ae2c-116d-4f2f-a7e6-dc97e716df9f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:06.727508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 104/207] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:06 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:06.736107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17ea58-ab2b-4b91-965f-6a8868989739 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:06.894852 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a17ea58-ab2b-4b91-965f-6a8868989739 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:06.926727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:06.949374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de451-4b6b-4dbc-badd-6f887ecaa8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:06.950030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de451-4b6b-4dbc-badd-6f887ecaa8d9 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:06.950310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de451-4b6b-4dbc-badd-6f887ecaa8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:06.950609 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de451-4b6b-4dbc-badd-6f887ecaa8d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:06.951445 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de451-4b6b-4dbc-badd-6f887ecaa8d9 None admin] RBAC: Adding query filter params (role.id=a6ec97dc5f284af19eeca47e8f257622, scope.project.id=848b8e76a38e4d9da24492efeec48f1a, user.id=dcc6e6c5bd2f4175998ec4edb25dcbde) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:06.951755 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de451-4b6b-4dbc-badd-6f887ecaa8d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:06.953232 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de451-4b6b-4dbc-badd-6f887ecaa8d9 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:06.963332 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 104/208] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:06 2022] GET /identity/v3/role_assignments?user.id=dcc6e6c5bd2f4175998ec4edb25dcbde&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=a6ec97dc5f284af19eeca47e8f257622 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:08.005283 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d962097-a760-4175-9664-e203cc9eda88 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.005806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d962097-a760-4175-9664-e203cc9eda88 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.005916 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d962097-a760-4175-9664-e203cc9eda88 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.007430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 105/209] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:08.013155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aefb59-4f92-43e9-9c8b-6465dd5ff85e None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.013565 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aefb59-4f92-43e9-9c8b-6465dd5ff85e None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.013818 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aefb59-4f92-43e9-9c8b-6465dd5ff85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.032995 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-69aefb59-4f92-43e9-9c8b-6465dd5ff85e None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:08.034217 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-69aefb59-4f92-43e9-9c8b-6465dd5ff85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:08.075910 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5853eaf-3ee6-4f35-aee3-d99918acf51a None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.076220 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5853eaf-3ee6-4f35-aee3-d99918acf51a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.076473 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5853eaf-3ee6-4f35-aee3-d99918acf51a None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.078059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 106/210] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:08.083397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efd587-1b62-433f-a332-4dbd0626e226 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.083530 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efd587-1b62-433f-a332-4dbd0626e226 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.083743 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efd587-1b62-433f-a332-4dbd0626e226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.101467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-91efd587-1b62-433f-a332-4dbd0626e226 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:08.102727 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-91efd587-1b62-433f-a332-4dbd0626e226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:08.110877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 105/211] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:08.112592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbbac-9975-4c6e-9048-41fd6b887f3c None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.112880 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbbac-9975-4c6e-9048-41fd6b887f3c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.113155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870dbbac-9975-4c6e-9048-41fd6b887f3c None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.114452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 106/212] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:08.119641 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d944-2824-42bd-8554-05b665c6f2c1 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.120130 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d944-2824-42bd-8554-05b665c6f2c1 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.120592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157d944-2824-42bd-8554-05b665c6f2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.137878 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-2157d944-2824-42bd-8554-05b665c6f2c1 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:08.139090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-2157d944-2824-42bd-8554-05b665c6f2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:08.140772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:08.194982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 107/213] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:08.194982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efd587-1b62-433f-a332-4dbd0626e226 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.246461 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 107/214] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:08.246461 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157d944-2824-42bd-8554-05b665c6f2c1 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.288224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:08.319011 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efd587-1b62-433f-a332-4dbd0626e226 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:08.354070 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7702e-22c1-4277-a8d3-bfea5c49455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:08.355013 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7702e-22c1-4277-a8d3-bfea5c49455f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.355295 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7702e-22c1-4277-a8d3-bfea5c49455f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.355569 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb7702e-22c1-4277-a8d3-bfea5c49455f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.356426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157d944-2824-42bd-8554-05b665c6f2c1 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:08.368272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb7702e-22c1-4277-a8d3-bfea5c49455f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-feb7702e-22c1-4277-a8d3-bfea5c49455f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:08.376938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:08.377825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:08.378638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 108/215] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:08.380248 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7702e-22c1-4277-a8d3-bfea5c49455f None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.398221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406529e9-5850-4ec0-bafc-28b580997ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:08.399062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406529e9-5850-4ec0-bafc-28b580997ff4 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.399349 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406529e9-5850-4ec0-bafc-28b580997ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.399625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406529e9-5850-4ec0-bafc-28b580997ff4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.400796 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406529e9-5850-4ec0-bafc-28b580997ff4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:08.402266 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406529e9-5850-4ec0-bafc-28b580997ff4 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:08.403937 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 108/216] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:08.404424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:08.404694 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406529e9-5850-4ec0-bafc-28b580997ff4 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.485854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb7702e-22c1-4277-a8d3-bfea5c49455f None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:08.505167 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406529e9-5850-4ec0-bafc-28b580997ff4 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:08.515902 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:08.521102 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd6d11-14aa-48f4-a7a6-a133d11c54ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:08.521983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd6d11-14aa-48f4-a7a6-a133d11c54ae None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.522331 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd6d11-14aa-48f4-a7a6-a133d11c54ae None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.522703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd6d11-14aa-48f4-a7a6-a133d11c54ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.532905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd6d11-14aa-48f4-a7a6-a133d11c54ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-50cd6d11-14aa-48f4-a7a6-a133d11c54ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:08.540564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:08.541601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:08.547854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:08.548452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aeb11-9877-4eb7-bf58-1758e2c51ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:08.548538 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 109/217] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:08.548603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aeb11-9877-4eb7-bf58-1758e2c51ea2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.548603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aeb11-9877-4eb7-bf58-1758e2c51ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.548603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38aeb11-9877-4eb7-bf58-1758e2c51ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.549157 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930f2d3-8156-41b5-af45-3346a13197fb None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.549157 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930f2d3-8156-41b5-af45-3346a13197fb None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.549157 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930f2d3-8156-41b5-af45-3346a13197fb None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.549322 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aeb11-9877-4eb7-bf58-1758e2c51ea2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:08.549322 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aeb11-9877-4eb7-bf58-1758e2c51ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:08.549442 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 110/218] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:08.549507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38aeb11-9877-4eb7-bf58-1758e2c51ea2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:08.549570 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930f2d3-8156-41b5-af45-3346a13197fb None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.559459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 109/219] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:08.559459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aeb11-9877-4eb7-bf58-1758e2c51ea2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.630795 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:08.647754 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930f2d3-8156-41b5-af45-3346a13197fb None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:08.657257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38aeb11-9877-4eb7-bf58-1758e2c51ea2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:08.681527 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508639-b9ce-496e-b9c7-16cc3dcc2a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:08.682230 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508639-b9ce-496e-b9c7-16cc3dcc2a18 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.682544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508639-b9ce-496e-b9c7-16cc3dcc2a18 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.682821 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f508639-b9ce-496e-b9c7-16cc3dcc2a18 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.683543 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508639-b9ce-496e-b9c7-16cc3dcc2a18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:08.685029 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f508639-b9ce-496e-b9c7-16cc3dcc2a18 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:08.692113 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75fac4-d4d0-4bf4-a8d9-c09983be228f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:08.692776 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75fac4-d4d0-4bf4-a8d9-c09983be228f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.693057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75fac4-d4d0-4bf4-a8d9-c09983be228f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.693335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75fac4-d4d0-4bf4-a8d9-c09983be228f None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.694062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75fac4-d4d0-4bf4-a8d9-c09983be228f None admin] RBAC: Adding query filter params (name=member) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:08.694368 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75fac4-d4d0-4bf4-a8d9-c09983be228f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:08.695885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc75fac4-d4d0-4bf4-a8d9-c09983be228f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:08.705090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 110/220] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:08.706542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aea91f-d1fe-4021-b472-1b0aaca0e744 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.706658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 111/221] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:08 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:08.706735 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aea91f-d1fe-4021-b472-1b0aaca0e744 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.707010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aea91f-d1fe-4021-b472-1b0aaca0e744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.707239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508639-b9ce-496e-b9c7-16cc3dcc2a18 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.726243 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-d8aea91f-d1fe-4021-b472-1b0aaca0e744 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:08.727767 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-d8aea91f-d1fe-4021-b472-1b0aaca0e744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:08.760332 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:08.807534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 111/222] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:08.815453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aea91f-d1fe-4021-b472-1b0aaca0e744 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.838141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f508639-b9ce-496e-b9c7-16cc3dcc2a18 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:08.875719 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6814ee-bf9b-4471-b9a0-80d0c089e275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:08.876623 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6814ee-bf9b-4471-b9a0-80d0c089e275 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.876910 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6814ee-bf9b-4471-b9a0-80d0c089e275 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.877186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6814ee-bf9b-4471-b9a0-80d0c089e275 None admin] PATH_INFO: `/v3/users/87b7c39beda342cb9e815c5b71380531` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.878489 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6814ee-bf9b-4471-b9a0-80d0c089e275 None admin] RBAC: Authorizing `identity:get_user(user_id=87b7c39beda342cb9e815c5b71380531)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:08.879995 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6814ee-bf9b-4471-b9a0-80d0c089e275 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:08.881719 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 112/223] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:08 2022] GET /identity/v3/users/87b7c39beda342cb9e815c5b71380531 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:08.887231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6814ee-bf9b-4471-b9a0-80d0c089e275 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:08.900281 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:08.933969 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aea91f-d1fe-4021-b472-1b0aaca0e744 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:08.972250 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc3d1e-dc43-4e8f-b341-70d9d97f61ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:08.973150 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc3d1e-dc43-4e8f-b341-70d9d97f61ed None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:08.973445 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc3d1e-dc43-4e8f-b341-70d9d97f61ed None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:08.973713 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc3d1e-dc43-4e8f-b341-70d9d97f61ed None admin] PATH_INFO: `/v3/users/981157e6fd57442ba9e70536d2576d43` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:08.993355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc3d1e-dc43-4e8f-b341-70d9d97f61ed None admin] RBAC: Authorizing `identity:get_user(user_id=981157e6fd57442ba9e70536d2576d43)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:08.994903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc3d1e-dc43-4e8f-b341-70d9d97f61ed None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:08.997384 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 112/224] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:08 2022] GET /identity/v3/users/981157e6fd57442ba9e70536d2576d43 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:08.999570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc3d1e-dc43-4e8f-b341-70d9d97f61ed None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:09.022770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:09.024872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6814ee-bf9b-4471-b9a0-80d0c089e275 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:09.065553 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1cb33-bef6-44df-9e13-ffc056cbe0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:09.066539 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1cb33-bef6-44df-9e13-ffc056cbe0ff None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:09.066827 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1cb33-bef6-44df-9e13-ffc056cbe0ff None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:09.067410 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1cb33-bef6-44df-9e13-ffc056cbe0ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:09.078848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1cb33-bef6-44df-9e13-ffc056cbe0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-46a1cb33-bef6-44df-9e13-ffc056cbe0ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:09.086939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:09.087869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:09.088669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 113/225] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:09.089318 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1cb33-bef6-44df-9e13-ffc056cbe0ff None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:09.117162 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc3d1e-dc43-4e8f-b341-70d9d97f61ed None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:09.163605 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:09.166527 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5153-7ab9-4e62-b0fc-bb8fc76b61eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:09.169085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5153-7ab9-4e62-b0fc-bb8fc76b61eb None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:09.169376 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5153-7ab9-4e62-b0fc-bb8fc76b61eb None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:09.169657 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc5153-7ab9-4e62-b0fc-bb8fc76b61eb None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:09.170921 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc5153-7ab9-4e62-b0fc-bb8fc76b61eb None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:09.172648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc5153-7ab9-4e62-b0fc-bb8fc76b61eb None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:09.175314 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 113/226] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:08 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:09.176587 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5153-7ab9-4e62-b0fc-bb8fc76b61eb None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:09.200225 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1cb33-bef6-44df-9e13-ffc056cbe0ff None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:09.236986 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61626f1-48f5-4fa7-ba96-6a73defebaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:09.237647 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61626f1-48f5-4fa7-ba96-6a73defebaba None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:09.237932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61626f1-48f5-4fa7-ba96-6a73defebaba None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:09.238204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61626f1-48f5-4fa7-ba96-6a73defebaba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:09.300394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:09.314734 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61626f1-48f5-4fa7-ba96-6a73defebaba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:09.315985 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc5153-7ab9-4e62-b0fc-bb8fc76b61eb None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:09.316724 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61626f1-48f5-4fa7-ba96-6a73defebaba None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:09.362452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ee35c-f096-436d-8448-4a294ee7a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:09.362452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ee35c-f096-436d-8448-4a294ee7a480 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:09.362452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ee35c-f096-436d-8448-4a294ee7a480 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:09.362452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ee35c-f096-436d-8448-4a294ee7a480 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:09.363122 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ee35c-f096-436d-8448-4a294ee7a480 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:09.366054 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ee35c-f096-436d-8448-4a294ee7a480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:09.366054 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ee35c-f096-436d-8448-4a294ee7a480 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:09.373258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 114/227] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:09.374459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ee35c-f096-436d-8448-4a294ee7a480 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:09.394447 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:09.432418 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 114/228] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:09.433504 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61626f1-48f5-4fa7-ba96-6a73defebaba None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:09.506397 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ee35c-f096-436d-8448-4a294ee7a480 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:09.544270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61626f1-48f5-4fa7-ba96-6a73defebaba None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:09.561049 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c96f0-3679-4dab-9b83-29706c04be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:09.563663 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c96f0-3679-4dab-9b83-29706c04be26 None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:09.564656 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c96f0-3679-4dab-9b83-29706c04be26 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:09.565271 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c96f0-3679-4dab-9b83-29706c04be26 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94/users/87b7c39beda342cb9e815c5b71380531/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:09.568113 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c96f0-3679-4dab-9b83-29706c04be26 None admin] RBAC: Authorizing `identity:create_grant(project_id=36e5f01822474e888f237e6000a33a94, user_id=87b7c39beda342cb9e815c5b71380531, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:09.570007 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c96f0-3679-4dab-9b83-29706c04be26 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:09.586715 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d69763-7538-4773-b2b7-a275c0ccdc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:09.587962 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d69763-7538-4773-b2b7-a275c0ccdc3c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:09.588386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d69763-7538-4773-b2b7-a275c0ccdc3c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:09.588802 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d69763-7538-4773-b2b7-a275c0ccdc3c None admin] PATH_INFO: `/v3/users/87b7c39beda342cb9e815c5b71380531` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:09.588961 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 115/229] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:09 2022] PUT /identity/v3/projects/36e5f01822474e888f237e6000a33a94/users/87b7c39beda342cb9e815c5b71380531/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:09.590510 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d69763-7538-4773-b2b7-a275c0ccdc3c None admin] RBAC: Authorizing `identity:get_user(user_id=87b7c39beda342cb9e815c5b71380531)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:09.592330 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d69763-7538-4773-b2b7-a275c0ccdc3c None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:09.599384 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 115/230] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:09 2022] GET /identity/v3/users/87b7c39beda342cb9e815c5b71380531 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:09.599582 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c96f0-3679-4dab-9b83-29706c04be26 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:09.601145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d69763-7538-4773-b2b7-a275c0ccdc3c None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:09.628294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:09.651155 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:09.733597 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d69763-7538-4773-b2b7-a275c0ccdc3c None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:09.778390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566622b-a34c-4cc0-a5f1-89d75eef03aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:09.779559 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566622b-a34c-4cc0-a5f1-89d75eef03aa None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:09.779987 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566622b-a34c-4cc0-a5f1-89d75eef03aa None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:09.780400 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566622b-a34c-4cc0-a5f1-89d75eef03aa None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:09.781816 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566622b-a34c-4cc0-a5f1-89d75eef03aa None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:09.783587 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566622b-a34c-4cc0-a5f1-89d75eef03aa None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:09.786107 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 116/231] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:09 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:09.808436 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566622b-a34c-4cc0-a5f1-89d75eef03aa None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:09.845814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c96f0-3679-4dab-9b83-29706c04be26 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:09.891108 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631bbe4-2f04-43c5-9309-9a3a72ed4466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:09.892356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631bbe4-2f04-43c5-9309-9a3a72ed4466 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:09.892836 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631bbe4-2f04-43c5-9309-9a3a72ed4466 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:09.893352 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631bbe4-2f04-43c5-9309-9a3a72ed4466 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:09.897580 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631bbe4-2f04-43c5-9309-9a3a72ed4466 None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:09.900002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631bbe4-2f04-43c5-9309-9a3a72ed4466 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:09.902956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 116/232] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:09 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:09.909891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631bbe4-2f04-43c5-9309-9a3a72ed4466 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:10.003675 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566622b-a34c-4cc0-a5f1-89d75eef03aa None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:10.008295 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:10.051585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:10.065200 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b490eb-f5f4-4512-a902-13e1faa9a487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:10.066853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b490eb-f5f4-4512-a902-13e1faa9a487 None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:10.067334 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b490eb-f5f4-4512-a902-13e1faa9a487 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:10.067826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b490eb-f5f4-4512-a902-13e1faa9a487 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94/users/87b7c39beda342cb9e815c5b71380531/roles/85d95bf96f68469397338d49ad9fd8fa` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:10.070435 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b490eb-f5f4-4512-a902-13e1faa9a487 None admin] RBAC: Authorizing `identity:create_grant(project_id=36e5f01822474e888f237e6000a33a94, user_id=87b7c39beda342cb9e815c5b71380531, role_id=85d95bf96f68469397338d49ad9fd8fa)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:10.072202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b490eb-f5f4-4512-a902-13e1faa9a487 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:10.096457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 117/233] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:09 2022] PUT /identity/v3/projects/36e5f01822474e888f237e6000a33a94/users/87b7c39beda342cb9e815c5b71380531/roles/85d95bf96f68469397338d49ad9fd8fa => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:35:10.099911 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631bbe4-2f04-43c5-9309-9a3a72ed4466 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:10.143527 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1673d-de88-4f2f-8501-1a9646323cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:10.144577 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1673d-de88-4f2f-8501-1a9646323cb2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:10.145061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1673d-de88-4f2f-8501-1a9646323cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:10.145534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1673d-de88-4f2f-8501-1a9646323cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:10.146599 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1673d-de88-4f2f-8501-1a9646323cb2 None admin] RBAC: Adding query filter params (role.id=209cb6e49795432bb796352cec30474f, scope.project.id=36e5f01822474e888f237e6000a33a94, user.id=981157e6fd57442ba9e70536d2576d43) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:10.147216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1673d-de88-4f2f-8501-1a9646323cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:10.148897 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1673d-de88-4f2f-8501-1a9646323cb2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:10.159352 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 117/234] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:09 2022] GET /identity/v3/role_assignments?user.id=981157e6fd57442ba9e70536d2576d43&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=209cb6e49795432bb796352cec30474f => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:11.398815 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a4c48-bd39-4d3d-bf0e-182b00472b0d None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.399368 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a4c48-bd39-4d3d-bf0e-182b00472b0d None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.399368 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a4c48-bd39-4d3d-bf0e-182b00472b0d None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.400995 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 118/235] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:11.405784 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd62b9-fccd-446c-94d2-020f2b61555b None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.406232 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd62b9-fccd-446c-94d2-020f2b61555b None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.406603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dd62b9-fccd-446c-94d2-020f2b61555b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.431375 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-72dd62b9-fccd-446c-94d2-020f2b61555b None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:11.432565 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-72dd62b9-fccd-446c-94d2-020f2b61555b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:11.484481 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17985d9-c3eb-4df4-bb30-870cb3b968ff None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.485218 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17985d9-c3eb-4df4-bb30-870cb3b968ff None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.485218 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17985d9-c3eb-4df4-bb30-870cb3b968ff None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.486404 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 119/236] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:11.491236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e9df-5d39-4fcd-af31-5f24be4c9da2 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.491530 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e9df-5d39-4fcd-af31-5f24be4c9da2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.491812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e9df-5d39-4fcd-af31-5f24be4c9da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.512289 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-7156e9df-5d39-4fcd-af31-5f24be4c9da2 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:11.513505 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-7156e9df-5d39-4fcd-af31-5f24be4c9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:11.518465 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 118/237] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:11.545513 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd62b9-fccd-446c-94d2-020f2b61555b None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:11.608995 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 120/238] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:11.636136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156e9df-5d39-4fcd-af31-5f24be4c9da2 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:11.707613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:11.765905 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dd62b9-fccd-446c-94d2-020f2b61555b None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:11.800044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:11.805831 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bc4f2-f42c-416a-913b-b70f043912c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:11.806768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bc4f2-f42c-416a-913b-b70f043912c2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.807059 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bc4f2-f42c-416a-913b-b70f043912c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.807370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5bc4f2-f42c-416a-913b-b70f043912c2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.809347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bc4f2-f42c-416a-913b-b70f043912c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:11.811014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5bc4f2-f42c-416a-913b-b70f043912c2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:11.813047 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 119/239] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:11.816537 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156e9df-5d39-4fcd-af31-5f24be4c9da2 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:11.818638 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bc4f2-f42c-416a-913b-b70f043912c2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:11.895198 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30accd-d395-4455-ae9d-d81fc5adc9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:11.896029 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30accd-d395-4455-ae9d-d81fc5adc9ce None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:11.896315 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30accd-d395-4455-ae9d-d81fc5adc9ce None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:11.896595 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30accd-d395-4455-ae9d-d81fc5adc9ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:11.927995 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30accd-d395-4455-ae9d-d81fc5adc9ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-2a30accd-d395-4455-ae9d-d81fc5adc9ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:11.935938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:11.936811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:11.937643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 121/240] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:11.943418 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30accd-d395-4455-ae9d-d81fc5adc9ce None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:11.977825 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5bc4f2-f42c-416a-913b-b70f043912c2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.044204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458d9a8-975a-4dcf-b5c1-eb2b1fab75f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.045128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458d9a8-975a-4dcf-b5c1-eb2b1fab75f8 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.047081 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458d9a8-975a-4dcf-b5c1-eb2b1fab75f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.048015 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458d9a8-975a-4dcf-b5c1-eb2b1fab75f8 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.049807 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458d9a8-975a-4dcf-b5c1-eb2b1fab75f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.051467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5458d9a8-975a-4dcf-b5c1-eb2b1fab75f8 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.062671 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.081496 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 120/241] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:11 2022] POST /identity/v3/users => generated 293 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:12.090351 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30accd-d395-4455-ae9d-d81fc5adc9ce None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.148376 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d381e2-fd4d-4a00-ab83-f5e57fc60a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.149331 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d381e2-fd4d-4a00-ab83-f5e57fc60a4f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.149761 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d381e2-fd4d-4a00-ab83-f5e57fc60a4f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.150182 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d381e2-fd4d-4a00-ab83-f5e57fc60a4f None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.151245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d381e2-fd4d-4a00-ab83-f5e57fc60a4f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:12.151708 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d381e2-fd4d-4a00-ab83-f5e57fc60a4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.153308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d381e2-fd4d-4a00-ab83-f5e57fc60a4f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.167370 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 122/242] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:12.173453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458d9a8-975a-4dcf-b5c1-eb2b1fab75f8 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.290753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458d9a8-975a-4dcf-b5c1-eb2b1fab75f8 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.333357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0e4f6-7edf-4a7d-9bec-03813a00519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.334564 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0e4f6-7edf-4a7d-9bec-03813a00519d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.335001 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0e4f6-7edf-4a7d-9bec-03813a00519d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.335423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0e4f6-7edf-4a7d-9bec-03813a00519d None admin] PATH_INFO: `/v3/users/6ec82353b0c74ed18834b0acefffad95` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.353120 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0e4f6-7edf-4a7d-9bec-03813a00519d None admin] RBAC: Authorizing `identity:get_user(user_id=6ec82353b0c74ed18834b0acefffad95)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.354913 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0e4f6-7edf-4a7d-9bec-03813a00519d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.357175 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 121/243] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/users/6ec82353b0c74ed18834b0acefffad95 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:12.362649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d381e2-fd4d-4a00-ab83-f5e57fc60a4f None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.384387 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.474847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d381e2-fd4d-4a00-ab83-f5e57fc60a4f None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.515101 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f1639-9358-4a47-b478-065d3ba7c8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.515918 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f1639-9358-4a47-b478-065d3ba7c8c2 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.516484 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f1639-9358-4a47-b478-065d3ba7c8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.516650 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f1639-9358-4a47-b478-065d3ba7c8c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.584940 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1fcc-89fa-42c2-bf3d-39f4524a48a1 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.585981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1fcc-89fa-42c2-bf3d-39f4524a48a1 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.589534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f1639-9358-4a47-b478-065d3ba7c8c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.589977 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1fcc-89fa-42c2-bf3d-39f4524a48a1 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.591167 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f1639-9358-4a47-b478-065d3ba7c8c2 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.592503 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 122/244] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:12.599557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05155f0-c5a5-49c7-8df3-b8d4e32ce923 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.600139 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05155f0-c5a5-49c7-8df3-b8d4e32ce923 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.600616 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05155f0-c5a5-49c7-8df3-b8d4e32ce923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.618788 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.626906 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-d05155f0-c5a5-49c7-8df3-b8d4e32ce923 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:12.628337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-d05155f0-c5a5-49c7-8df3-b8d4e32ce923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:12.692092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.712390 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 123/245] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:12.712574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 123/246] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:12.717992 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05155f0-c5a5-49c7-8df3-b8d4e32ce923 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.746344 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f1639-9358-4a47-b478-065d3ba7c8c2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.858150 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05155f0-c5a5-49c7-8df3-b8d4e32ce923 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.879718 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f1639-9358-4a47-b478-065d3ba7c8c2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:12.904019 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b8568-9d27-46aa-86f5-f7d3e7aff6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.905076 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b8568-9d27-46aa-86f5-f7d3e7aff6d9 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.905572 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b8568-9d27-46aa-86f5-f7d3e7aff6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.905724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3b8568-9d27-46aa-86f5-f7d3e7aff6d9 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.907292 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b8568-9d27-46aa-86f5-f7d3e7aff6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:12.908878 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3b8568-9d27-46aa-86f5-f7d3e7aff6d9 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:12.911005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 124/247] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:12.916979 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b8568-9d27-46aa-86f5-f7d3e7aff6d9 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:12.923139 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:12.937725 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6af1f9-f84b-45b6-b10c-b539e72a3ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:12.938577 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6af1f9-f84b-45b6-b10c-b539e72a3ff0 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:12.938861 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6af1f9-f84b-45b6-b10c-b539e72a3ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:12.939135 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6af1f9-f84b-45b6-b10c-b539e72a3ff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:12.952445 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6af1f9-f84b-45b6-b10c-b539e72a3ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-7d6af1f9-f84b-45b6-b10c-b539e72a3ff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:12.961187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:12.963772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:12.965075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 124/248] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:12.968287 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6af1f9-f84b-45b6-b10c-b539e72a3ff0 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.003898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.065323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3b8568-9d27-46aa-86f5-f7d3e7aff6d9 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.077709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6af1f9-f84b-45b6-b10c-b539e72a3ff0 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.104675 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551dcb80-f461-443f-9430-ff20a8760672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.105836 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551dcb80-f461-443f-9430-ff20a8760672 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.106408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551dcb80-f461-443f-9430-ff20a8760672 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.107000 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551dcb80-f461-443f-9430-ff20a8760672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.108076 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551dcb80-f461-443f-9430-ff20a8760672 None admin] RBAC: Adding query filter params (role.id=a6ec97dc5f284af19eeca47e8f257622, scope.project.id=36e5f01822474e888f237e6000a33a94, user.id=6ec82353b0c74ed18834b0acefffad95) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:13.108683 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551dcb80-f461-443f-9430-ff20a8760672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.110760 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551dcb80-f461-443f-9430-ff20a8760672 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.114744 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac94bf-c11f-4f6f-9a7c-34673a1d4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.115423 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac94bf-c11f-4f6f-9a7c-34673a1d4a79 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.115713 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac94bf-c11f-4f6f-9a7c-34673a1d4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.115996 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac94bf-c11f-4f6f-9a7c-34673a1d4a79 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.116750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac94bf-c11f-4f6f-9a7c-34673a1d4a79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:13.117062 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac94bf-c11f-4f6f-9a7c-34673a1d4a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.118488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac94bf-c11f-4f6f-9a7c-34673a1d4a79 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.119116 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 125/249] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/role_assignments?user.id=6ec82353b0c74ed18834b0acefffad95&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=a6ec97dc5f284af19eeca47e8f257622 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:13.120784 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72262fd-e7d6-40ce-b5bb-6080585daf20 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.121277 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72262fd-e7d6-40ce-b5bb-6080585daf20 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.127038 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72262fd-e7d6-40ce-b5bb-6080585daf20 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.128294 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 125/250] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:13.129128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 126/251] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:13.133920 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac94bf-c11f-4f6f-9a7c-34673a1d4a79 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.136879 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782843f-48f9-4a65-8702-e35d39ce712d None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.137515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782843f-48f9-4a65-8702-e35d39ce712d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.137985 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782843f-48f9-4a65-8702-e35d39ce712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.167709 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-7782843f-48f9-4a65-8702-e35d39ce712d None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:13.169346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-7782843f-48f9-4a65-8702-e35d39ce712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:13.179284 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.247567 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac94bf-c11f-4f6f-9a7c-34673a1d4a79 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.316585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2f241-d8a5-49b6-a45f-194b9fc9fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.317487 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2f241-d8a5-49b6-a45f-194b9fc9fb82 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.317773 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2f241-d8a5-49b6-a45f-194b9fc9fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.318055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2f241-d8a5-49b6-a45f-194b9fc9fb82 None admin] PATH_INFO: `/v3/users/87b7c39beda342cb9e815c5b71380531` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.319366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2f241-d8a5-49b6-a45f-194b9fc9fb82 None admin] RBAC: Authorizing `identity:get_user(user_id=87b7c39beda342cb9e815c5b71380531)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.320878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2f241-d8a5-49b6-a45f-194b9fc9fb82 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.322580 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 126/252] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/users/87b7c39beda342cb9e815c5b71380531 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:13.324199 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d5d20-8966-4a70-98dc-f72376cd4f3c None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.324199 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d5d20-8966-4a70-98dc-f72376cd4f3c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.324568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d5d20-8966-4a70-98dc-f72376cd4f3c None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.325839 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 127/253] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:13.332004 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93f53-7f54-4e86-bc8a-6fd3f2f6218b None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.332407 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93f53-7f54-4e86-bc8a-6fd3f2f6218b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.332818 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c93f53-7f54-4e86-bc8a-6fd3f2f6218b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.350233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 127/254] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:13.351160 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782843f-48f9-4a65-8702-e35d39ce712d None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.361452 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-a4c93f53-7f54-4e86-bc8a-6fd3f2f6218b None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:13.362646 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-a4c93f53-7f54-4e86-bc8a-6fd3f2f6218b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:13.407117 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.460867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 128/255] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:13.462318 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c93f53-7f54-4e86-bc8a-6fd3f2f6218b None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.464003 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782843f-48f9-4a65-8702-e35d39ce712d None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.526790 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.540941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972163e4-4b02-4fde-9f61-0eb21b950df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.541870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972163e4-4b02-4fde-9f61-0eb21b950df0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.542161 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972163e4-4b02-4fde-9f61-0eb21b950df0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.542470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972163e4-4b02-4fde-9f61-0eb21b950df0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.660747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c93f53-7f54-4e86-bc8a-6fd3f2f6218b None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.672826 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972163e4-4b02-4fde-9f61-0eb21b950df0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.674347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972163e4-4b02-4fde-9f61-0eb21b950df0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.726819 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306defb-a64d-4457-b995-0ca5009ffb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.727645 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306defb-a64d-4457-b995-0ca5009ffb60 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.727934 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306defb-a64d-4457-b995-0ca5009ffb60 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.728210 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306defb-a64d-4457-b995-0ca5009ffb60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.730802 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.748155 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306defb-a64d-4457-b995-0ca5009ffb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-9306defb-a64d-4457-b995-0ca5009ffb60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:13.764316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:13.765215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:13.766038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 129/256] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:13.771405 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306defb-a64d-4457-b995-0ca5009ffb60 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.786447 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 128/257] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:13.786447 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972163e4-4b02-4fde-9f61-0eb21b950df0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:13.901591 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972163e4-4b02-4fde-9f61-0eb21b950df0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.964330 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea731b77-537b-481b-904f-be64cbd6d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:13.965052 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea731b77-537b-481b-904f-be64cbd6d920 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:13.965342 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea731b77-537b-481b-904f-be64cbd6d920 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:13.965642 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea731b77-537b-481b-904f-be64cbd6d920 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:13.966733 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:13.967318 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea731b77-537b-481b-904f-be64cbd6d920 None admin] RBAC: Adding query filter params (name=member) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:13.967424 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea731b77-537b-481b-904f-be64cbd6d920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:13.969223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea731b77-537b-481b-904f-be64cbd6d920 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:13.973324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306defb-a64d-4457-b995-0ca5009ffb60 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:13.984944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 129/258] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:13.991807 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea731b77-537b-481b-904f-be64cbd6d920 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.009018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:14.014173 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fbdb7-3ce8-40a2-b7b7-fc770a1e58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.015035 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fbdb7-3ce8-40a2-b7b7-fc770a1e58f2 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.015327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fbdb7-3ce8-40a2-b7b7-fc770a1e58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.015665 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fbdb7-3ce8-40a2-b7b7-fc770a1e58f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.026538 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813fbdb7-3ce8-40a2-b7b7-fc770a1e58f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-813fbdb7-3ce8-40a2-b7b7-fc770a1e58f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:14.034750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:14.035609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:14.036382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 130/259] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:14.037013 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fbdb7-3ce8-40a2-b7b7-fc770a1e58f2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.150633 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fbdb7-3ce8-40a2-b7b7-fc770a1e58f2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.172397 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea731b77-537b-481b-904f-be64cbd6d920 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.185019 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44495-234e-4c0d-afee-f19f333adf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.185841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44495-234e-4c0d-afee-f19f333adf19 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.186130 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44495-234e-4c0d-afee-f19f333adf19 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.186434 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44495-234e-4c0d-afee-f19f333adf19 None admin] PATH_INFO: `/v3/users/981157e6fd57442ba9e70536d2576d43` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.187939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c44495-234e-4c0d-afee-f19f333adf19 None admin] RBAC: Authorizing `identity:get_user(user_id=981157e6fd57442ba9e70536d2576d43)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.189585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c44495-234e-4c0d-afee-f19f333adf19 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.194443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 131/260] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/users/981157e6fd57442ba9e70536d2576d43 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.194443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44495-234e-4c0d-afee-f19f333adf19 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.227047 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:14.291126 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0ff98-022d-4d0b-8ddf-6836e0355cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.292417 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ff98-022d-4d0b-8ddf-6836e0355cb0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.292896 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ff98-022d-4d0b-8ddf-6836e0355cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.293363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ff98-022d-4d0b-8ddf-6836e0355cb0 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.294841 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0ff98-022d-4d0b-8ddf-6836e0355cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.296509 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0ff98-022d-4d0b-8ddf-6836e0355cb0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.298463 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44495-234e-4c0d-afee-f19f333adf19 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.298750 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 130/261] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:13 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.299704 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0ff98-022d-4d0b-8ddf-6836e0355cb0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.358978 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d9a0-dc49-4e86-b125-0cbeb4278f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.359695 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d9a0-dc49-4e86-b125-0cbeb4278f87 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.359983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d9a0-dc49-4e86-b125-0cbeb4278f87 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.360263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658d9a0-dc49-4e86-b125-0cbeb4278f87 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.361016 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658d9a0-dc49-4e86-b125-0cbeb4278f87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:14.361327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658d9a0-dc49-4e86-b125-0cbeb4278f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.362765 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658d9a0-dc49-4e86-b125-0cbeb4278f87 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.381290 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 132/262] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.382129 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d9a0-dc49-4e86-b125-0cbeb4278f87 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.454876 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:14.491114 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0ff98-022d-4d0b-8ddf-6836e0355cb0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.528837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:14.542220 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658d9a0-dc49-4e86-b125-0cbeb4278f87 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.575134 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440092a-ae12-4c52-b3f0-ed45d219e2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.576068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440092a-ae12-4c52-b3f0-ed45d219e2aa None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.576356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440092a-ae12-4c52-b3f0-ed45d219e2aa None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.576639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440092a-ae12-4c52-b3f0-ed45d219e2aa None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.578006 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440092a-ae12-4c52-b3f0-ed45d219e2aa None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.580160 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440092a-ae12-4c52-b3f0-ed45d219e2aa None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.581321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06873f-71ac-4a50-9a13-d5355e6bbcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.581913 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 131/263] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.582018 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06873f-71ac-4a50-9a13-d5355e6bbcf8 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.582261 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06873f-71ac-4a50-9a13-d5355e6bbcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.582659 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06873f-71ac-4a50-9a13-d5355e6bbcf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.583583 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06873f-71ac-4a50-9a13-d5355e6bbcf8 None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=36e5f01822474e888f237e6000a33a94, user.id=87b7c39beda342cb9e815c5b71380531) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:14.583976 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06873f-71ac-4a50-9a13-d5355e6bbcf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.585437 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06873f-71ac-4a50-9a13-d5355e6bbcf8 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.591588 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440092a-ae12-4c52-b3f0-ed45d219e2aa None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.595623 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 133/264] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/role_assignments?user.id=87b7c39beda342cb9e815c5b71380531&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=8e22816a513845d88f4934c2164a142b => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.596488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06873f-71ac-4a50-9a13-d5355e6bbcf8 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.809478 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06873f-71ac-4a50-9a13-d5355e6bbcf8 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.837855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440092a-ae12-4c52-b3f0-ed45d219e2aa None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:14.869423 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2ef6b-3125-4b33-bae3-8e923cf48340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.870361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2ef6b-3125-4b33-bae3-8e923cf48340 None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.870673 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2ef6b-3125-4b33-bae3-8e923cf48340 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.870955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2ef6b-3125-4b33-bae3-8e923cf48340 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94/users/981157e6fd57442ba9e70536d2576d43/roles/209cb6e49795432bb796352cec30474f` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.873004 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2ef6b-3125-4b33-bae3-8e923cf48340 None admin] RBAC: Authorizing `identity:create_grant(project_id=36e5f01822474e888f237e6000a33a94, user_id=981157e6fd57442ba9e70536d2576d43, role_id=209cb6e49795432bb796352cec30474f)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.874644 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2ef6b-3125-4b33-bae3-8e923cf48340 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.884237 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d6da2-c5e4-4813-a2c2-a6e619760d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:14.885166 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d6da2-c5e4-4813-a2c2-a6e619760d3b None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:14.885417 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d6da2-c5e4-4813-a2c2-a6e619760d3b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:14.885696 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d6da2-c5e4-4813-a2c2-a6e619760d3b None admin] PATH_INFO: `/v3/users/87b7c39beda342cb9e815c5b71380531` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:14.887588 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d6da2-c5e4-4813-a2c2-a6e619760d3b None admin] RBAC: Authorizing `identity:get_user(user_id=87b7c39beda342cb9e815c5b71380531)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:14.889319 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840d6da2-c5e4-4813-a2c2-a6e619760d3b None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:14.891545 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 132/265] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/users/87b7c39beda342cb9e815c5b71380531 => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:14.900642 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d6da2-c5e4-4813-a2c2-a6e619760d3b None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:14.904374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 134/266] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:14 2022] PUT /identity/v3/projects/36e5f01822474e888f237e6000a33a94/users/981157e6fd57442ba9e70536d2576d43/roles/209cb6e49795432bb796352cec30474f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:14.930858 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:15.047579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840d6da2-c5e4-4813-a2c2-a6e619760d3b None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:15.089324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb25f4-ce13-4da7-8f25-c48880085448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:15.090034 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb25f4-ce13-4da7-8f25-c48880085448 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:15.090318 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb25f4-ce13-4da7-8f25-c48880085448 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:15.090661 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb25f4-ce13-4da7-8f25-c48880085448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:15.174840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb25f4-ce13-4da7-8f25-c48880085448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:15.176330 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcb25f4-ce13-4da7-8f25-c48880085448 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:15.196148 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:15.307347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 133/267] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:35:15.313387 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2ef6b-3125-4b33-bae3-8e923cf48340 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:15.330461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:15.430517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2ef6b-3125-4b33-bae3-8e923cf48340 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:15.475776 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595d584-ec9a-45eb-9780-3b6e358eb407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:15.476650 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d584-ec9a-45eb-9780-3b6e358eb407 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:15.476932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d584-ec9a-45eb-9780-3b6e358eb407 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:15.477204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595d584-ec9a-45eb-9780-3b6e358eb407 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:15.482513 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595d584-ec9a-45eb-9780-3b6e358eb407 None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:15.482513 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595d584-ec9a-45eb-9780-3b6e358eb407 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:15.482513 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 135/268] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:15 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:15.491546 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb25f4-ce13-4da7-8f25-c48880085448 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:15.558825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714cdd8-9183-44a1-8d75-1861f2e7af56 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:15.559337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714cdd8-9183-44a1-8d75-1861f2e7af56 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:15.559408 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714cdd8-9183-44a1-8d75-1861f2e7af56 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:15.560719 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 136/269] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:15.566324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a2ca-6e11-4e33-8eec-17748e4ea298 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:15.566633 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a2ca-6e11-4e33-8eec-17748e4ea298 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:15.566912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24a2ca-6e11-4e33-8eec-17748e4ea298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:15.586399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-bb24a2ca-6e11-4e33-8eec-17748e4ea298 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:15.587652 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-bb24a2ca-6e11-4e33-8eec-17748e4ea298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:15.608507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb25f4-ce13-4da7-8f25-c48880085448 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:15.630193 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:15.658210 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38889d7-b730-4eeb-8db8-6e1e4872279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:15.659185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38889d7-b730-4eeb-8db8-6e1e4872279d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:15.659638 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38889d7-b730-4eeb-8db8-6e1e4872279d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:15.660158 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38889d7-b730-4eeb-8db8-6e1e4872279d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:15.661154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38889d7-b730-4eeb-8db8-6e1e4872279d None admin] RBAC: Adding query filter params (role.id=85d95bf96f68469397338d49ad9fd8fa, scope.project.id=36e5f01822474e888f237e6000a33a94, user.id=87b7c39beda342cb9e815c5b71380531) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:15.661633 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38889d7-b730-4eeb-8db8-6e1e4872279d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:15.663367 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38889d7-b730-4eeb-8db8-6e1e4872279d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:15.671376 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 134/270] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:15 2022] GET /identity/v3/role_assignments?user.id=87b7c39beda342cb9e815c5b71380531&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=85d95bf96f68469397338d49ad9fd8fa => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:15.697099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 137/271] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:15.740438 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38889d7-b730-4eeb-8db8-6e1e4872279d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:15.866792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38889d7-b730-4eeb-8db8-6e1e4872279d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:15.869488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b3170-a9bc-4ae9-ac6b-68314cc5d856 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:15.869997 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b3170-a9bc-4ae9-ac6b-68314cc5d856 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:15.870595 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b3170-a9bc-4ae9-ac6b-68314cc5d856 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:15.873931 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 138/272] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:15.884098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e454-d3a0-41ec-8e35-2ca9e68b1b43 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:15.884728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e454-d3a0-41ec-8e35-2ca9e68b1b43 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:15.885199 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2e454-d3a0-41ec-8e35-2ca9e68b1b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:15.907956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-0ae2e454-d3a0-41ec-8e35-2ca9e68b1b43 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:15.909552 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-0ae2e454-d3a0-41ec-8e35-2ca9e68b1b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:15.912678 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:15.945027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeafa2e-24b1-43ee-a375-4c0be3a51f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:15.945856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeafa2e-24b1-43ee-a375-4c0be3a51f93 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:15.946265 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeafa2e-24b1-43ee-a375-4c0be3a51f93 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:15.946538 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeafa2e-24b1-43ee-a375-4c0be3a51f93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:15.947946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeafa2e-24b1-43ee-a375-4c0be3a51f93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:15.951072 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeafa2e-24b1-43ee-a375-4c0be3a51f93 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:15.951072 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 135/273] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:15.957587 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeafa2e-24b1-43ee-a375-4c0be3a51f93 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.005921 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 139/274] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:16.031105 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:16.041973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2e454-d3a0-41ec-8e35-2ca9e68b1b43 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.089359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeafa2e-24b1-43ee-a375-4c0be3a51f93 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.126976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071b95-4190-4c6b-bcc9-7f5b375c42ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.128049 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071b95-4190-4c6b-bcc9-7f5b375c42ec None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.128530 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071b95-4190-4c6b-bcc9-7f5b375c42ec None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.128999 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071b95-4190-4c6b-bcc9-7f5b375c42ec None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.129917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071b95-4190-4c6b-bcc9-7f5b375c42ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:16.131744 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071b95-4190-4c6b-bcc9-7f5b375c42ec None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:16.157460 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 136/275] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:15 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:16.183786 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa7655-a725-449d-aec6-e9b5cd37e009 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.184777 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa7655-a725-449d-aec6-e9b5cd37e009 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.185269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa7655-a725-449d-aec6-e9b5cd37e009 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.188798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 137/276] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:16.191572 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2e454-d3a0-41ec-8e35-2ca9e68b1b43 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.194595 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb687d-0ea2-43a7-b707-1bcb8d738d50 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.194884 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb687d-0ea2-43a7-b707-1bcb8d738d50 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.195173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb687d-0ea2-43a7-b707-1bcb8d738d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.214165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-95eb687d-0ea2-43a7-b707-1bcb8d738d50 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:16.215256 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-95eb687d-0ea2-43a7-b707-1bcb8d738d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:16.237343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10de93-10af-4ff5-b071-f3afb5a5e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.238168 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10de93-10af-4ff5-b071-f3afb5a5e78d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.238474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10de93-10af-4ff5-b071-f3afb5a5e78d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.238756 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10de93-10af-4ff5-b071-f3afb5a5e78d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.250964 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:16.257541 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10de93-10af-4ff5-b071-f3afb5a5e78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-8b10de93-10af-4ff5-b071-f3afb5a5e78d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:16.268242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:16.269197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:16.270202 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 140/277] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:16.275327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10de93-10af-4ff5-b071-f3afb5a5e78d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.301098 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 138/278] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:16.326242 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb687d-0ea2-43a7-b707-1bcb8d738d50 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.374871 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:16.390491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10de93-10af-4ff5-b071-f3afb5a5e78d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.433736 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1f690-fd8f-41ca-8a12-de76697b90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.434922 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1f690-fd8f-41ca-8a12-de76697b90ab None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.435207 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1f690-fd8f-41ca-8a12-de76697b90ab None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.435485 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1f690-fd8f-41ca-8a12-de76697b90ab None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.436233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1f690-fd8f-41ca-8a12-de76697b90ab None admin] RBAC: Adding query filter params (name=member) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:16.436896 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1f690-fd8f-41ca-8a12-de76697b90ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:16.440307 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1f690-fd8f-41ca-8a12-de76697b90ab None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:16.449214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 141/279] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:16.456703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1f690-fd8f-41ca-8a12-de76697b90ab None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.465541 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb687d-0ea2-43a7-b707-1bcb8d738d50 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.507379 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ca1c8-b94a-4bc1-873d-eed51de7cbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.508189 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca1c8-b94a-4bc1-873d-eed51de7cbcf None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.508467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca1c8-b94a-4bc1-873d-eed51de7cbcf None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.508734 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ca1c8-b94a-4bc1-873d-eed51de7cbcf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.522209 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ca1c8-b94a-4bc1-873d-eed51de7cbcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:16.529378 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-d89ca1c8-b94a-4bc1-873d-eed51de7cbcf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:16.535137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:16.536190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:16.537018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 139/280] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:16.543012 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ca1c8-b94a-4bc1-873d-eed51de7cbcf None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.586883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1f690-fd8f-41ca-8a12-de76697b90ab None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.635873 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e812a4b-0594-4d71-bcb0-49d2bff33b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.637033 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e812a4b-0594-4d71-bcb0-49d2bff33b23 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.637452 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e812a4b-0594-4d71-bcb0-49d2bff33b23 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.637863 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e812a4b-0594-4d71-bcb0-49d2bff33b23 None admin] PATH_INFO: `/v3/users/d7223e44e01944979f8425d33abfc667` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.656312 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e812a4b-0594-4d71-bcb0-49d2bff33b23 None admin] RBAC: Authorizing `identity:get_user(user_id=d7223e44e01944979f8425d33abfc667)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:16.658161 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e812a4b-0594-4d71-bcb0-49d2bff33b23 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:16.660173 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 142/281] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/users/d7223e44e01944979f8425d33abfc667 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:16.668227 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e812a4b-0594-4d71-bcb0-49d2bff33b23 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.669990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:16.682467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ca1c8-b94a-4bc1-873d-eed51de7cbcf None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.726162 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841df481-e3dc-4d8b-95b2-796bc6c0ecbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.726786 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841df481-e3dc-4d8b-95b2-796bc6c0ecbc None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.727215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841df481-e3dc-4d8b-95b2-796bc6c0ecbc None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.727507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841df481-e3dc-4d8b-95b2-796bc6c0ecbc None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.728562 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841df481-e3dc-4d8b-95b2-796bc6c0ecbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:16.728885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841df481-e3dc-4d8b-95b2-796bc6c0ecbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:16.730298 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841df481-e3dc-4d8b-95b2-796bc6c0ecbc None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:16.742257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 140/282] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:16.747681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841df481-e3dc-4d8b-95b2-796bc6c0ecbc None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:16.788153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e812a4b-0594-4d71-bcb0-49d2bff33b23 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.807223 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:16.827084 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794a117-7ba1-4e20-a816-e65bd8f67753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.828175 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794a117-7ba1-4e20-a816-e65bd8f67753 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.828648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794a117-7ba1-4e20-a816-e65bd8f67753 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.829200 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794a117-7ba1-4e20-a816-e65bd8f67753 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.830310 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794a117-7ba1-4e20-a816-e65bd8f67753 None admin] RBAC: Adding query filter params (role.id=209cb6e49795432bb796352cec30474f, user.id=d7223e44e01944979f8425d33abfc667, scope.system=all) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:16.830866 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794a117-7ba1-4e20-a816-e65bd8f67753 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:16.832521 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794a117-7ba1-4e20-a816-e65bd8f67753 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:16.838142 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 143/283] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/role_assignments?user.id=d7223e44e01944979f8425d33abfc667&scope.system=all&role.id=209cb6e49795432bb796352cec30474f => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:16.867188 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841df481-e3dc-4d8b-95b2-796bc6c0ecbc None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:16.904301 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95794ef7-2a84-4558-b3ff-3ec06fef8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:16.905211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95794ef7-2a84-4558-b3ff-3ec06fef8f70 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:16.905501 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95794ef7-2a84-4558-b3ff-3ec06fef8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:16.905783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95794ef7-2a84-4558-b3ff-3ec06fef8f70 None admin] PATH_INFO: `/v3/users/6ec82353b0c74ed18834b0acefffad95` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:16.907185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95794ef7-2a84-4558-b3ff-3ec06fef8f70 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec82353b0c74ed18834b0acefffad95)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:16.908666 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95794ef7-2a84-4558-b3ff-3ec06fef8f70 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:16.910664 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 141/284] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/users/6ec82353b0c74ed18834b0acefffad95 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:16.916314 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794a117-7ba1-4e20-a816-e65bd8f67753 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:17.039087 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794a117-7ba1-4e20-a816-e65bd8f67753 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:17.076452 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75df634-0092-4bb1-acc2-afff35c7fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:17.077341 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75df634-0092-4bb1-acc2-afff35c7fa65 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.077624 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75df634-0092-4bb1-acc2-afff35c7fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.077965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75df634-0092-4bb1-acc2-afff35c7fa65 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.079296 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75df634-0092-4bb1-acc2-afff35c7fa65 None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:17.080798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75df634-0092-4bb1-acc2-afff35c7fa65 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:17.082880 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 144/285] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:16 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:17.088671 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95794ef7-2a84-4558-b3ff-3ec06fef8f70 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:17.115200 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:17.211132 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95794ef7-2a84-4558-b3ff-3ec06fef8f70 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:17.262151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f896a094-c9d0-4d37-83f3-c9887a657255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:17.263071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896a094-c9d0-4d37-83f3-c9887a657255 None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:17.263355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896a094-c9d0-4d37-83f3-c9887a657255 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:17.263626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f896a094-c9d0-4d37-83f3-c9887a657255 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94/users/6ec82353b0c74ed18834b0acefffad95/roles/a6ec97dc5f284af19eeca47e8f257622` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:17.271763 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896a094-c9d0-4d37-83f3-c9887a657255 None admin] RBAC: Authorizing `identity:create_grant(project_id=36e5f01822474e888f237e6000a33a94, user_id=6ec82353b0c74ed18834b0acefffad95, role_id=a6ec97dc5f284af19eeca47e8f257622)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:17.273240 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f896a094-c9d0-4d37-83f3-c9887a657255 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:17.302009 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 142/286] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:17 2022] PUT /identity/v3/projects/36e5f01822474e888f237e6000a33a94/users/6ec82353b0c74ed18834b0acefffad95/roles/a6ec97dc5f284af19eeca47e8f257622 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:18.118608 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895b810-9b90-4c22-8b0f-3b98d46e0109 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.119612 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895b810-9b90-4c22-8b0f-3b98d46e0109 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.120089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895b810-9b90-4c22-8b0f-3b98d46e0109 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.121918 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 145/287] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:18.126912 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd24f7-5ee5-456c-8690-c8996aae26ae None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.127315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd24f7-5ee5-456c-8690-c8996aae26ae None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.127479 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd24f7-5ee5-456c-8690-c8996aae26ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.152505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-d6fd24f7-5ee5-456c-8690-c8996aae26ae None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:18.154080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-d6fd24f7-5ee5-456c-8690-c8996aae26ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:18.225218 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 143/288] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:18.266160 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895b810-9b90-4c22-8b0f-3b98d46e0109 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.329701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.399954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895b810-9b90-4c22-8b0f-3b98d46e0109 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.443550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882299-7d40-40d2-bc90-1153127c80ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.444356 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882299-7d40-40d2-bc90-1153127c80ff None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.444649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882299-7d40-40d2-bc90-1153127c80ff None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.444927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882299-7d40-40d2-bc90-1153127c80ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.461512 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882299-7d40-40d2-bc90-1153127c80ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-45882299-7d40-40d2-bc90-1153127c80ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:18.465372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:18.466239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:18.467069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 146/289] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:18.473044 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd24f7-5ee5-456c-8690-c8996aae26ae None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.486021 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.580042 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd24f7-5ee5-456c-8690-c8996aae26ae None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.629026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279eee3-d850-4209-bfab-3c5ba71977c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.629788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279eee3-d850-4209-bfab-3c5ba71977c0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.630078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279eee3-d850-4209-bfab-3c5ba71977c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.630356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279eee3-d850-4209-bfab-3c5ba71977c0 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.635308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279eee3-d850-4209-bfab-3c5ba71977c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:18.635635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279eee3-d850-4209-bfab-3c5ba71977c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:18.637076 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279eee3-d850-4209-bfab-3c5ba71977c0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:18.649724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 144/290] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:18.655613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882299-7d40-40d2-bc90-1153127c80ff None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.758759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882299-7d40-40d2-bc90-1153127c80ff None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.769863 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.794465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68b113-c290-4ef4-8c2c-a56a78d4ed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.795351 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b113-c290-4ef4-8c2c-a56a78d4ed93 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.795635 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b113-c290-4ef4-8c2c-a56a78d4ed93 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.795916 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68b113-c290-4ef4-8c2c-a56a78d4ed93 None admin] PATH_INFO: `/v3/users/981157e6fd57442ba9e70536d2576d43` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:18.797349 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68b113-c290-4ef4-8c2c-a56a78d4ed93 None admin] RBAC: Authorizing `identity:get_user(user_id=981157e6fd57442ba9e70536d2576d43)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:18.798861 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68b113-c290-4ef4-8c2c-a56a78d4ed93 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:18.800677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 147/291] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/users/981157e6fd57442ba9e70536d2576d43 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:18.806103 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279eee3-d850-4209-bfab-3c5ba71977c0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:18.892196 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:18.942079 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279eee3-d850-4209-bfab-3c5ba71977c0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:18.990723 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de8dbf-ccab-4700-b37a-6a0b3d84116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:18.991403 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de8dbf-ccab-4700-b37a-6a0b3d84116a None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:18.991691 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de8dbf-ccab-4700-b37a-6a0b3d84116a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:18.991973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de8dbf-ccab-4700-b37a-6a0b3d84116a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.085528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de8dbf-ccab-4700-b37a-6a0b3d84116a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.086957 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de8dbf-ccab-4700-b37a-6a0b3d84116a None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.199205 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.226693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c4226-6b69-4df3-a956-5f3c1a1f2f06 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.227186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c4226-6b69-4df3-a956-5f3c1a1f2f06 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.227257 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c4226-6b69-4df3-a956-5f3c1a1f2f06 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.228600 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 148/292] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:19.241990 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e164-9d07-46f7-acf7-3a448be81bf3 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.241990 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e164-9d07-46f7-acf7-3a448be81bf3 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.241990 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0e164-9d07-46f7-acf7-3a448be81bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.257072 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 145/293] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:19.266166 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-9ce0e164-9d07-46f7-acf7-3a448be81bf3 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:19.267481 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-9ce0e164-9d07-46f7-acf7-3a448be81bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:19.278504 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de8dbf-ccab-4700-b37a-6a0b3d84116a None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.371246 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 149/294] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:19.394988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0e164-9d07-46f7-acf7-3a448be81bf3 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.438167 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de8dbf-ccab-4700-b37a-6a0b3d84116a None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.476100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faffd6c-b96a-4af4-af23-4d7540cc82ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.477426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faffd6c-b96a-4af4-af23-4d7540cc82ce None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.477902 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faffd6c-b96a-4af4-af23-4d7540cc82ce None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.478411 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faffd6c-b96a-4af4-af23-4d7540cc82ce None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.479831 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faffd6c-b96a-4af4-af23-4d7540cc82ce None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.481678 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faffd6c-b96a-4af4-af23-4d7540cc82ce None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.483952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 146/295] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:19.495715 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faffd6c-b96a-4af4-af23-4d7540cc82ce None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.516947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0e164-9d07-46f7-acf7-3a448be81bf3 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.526741 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.550903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.559718 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc1446-d74d-41b9-8c92-0f23840a2f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.560823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc1446-d74d-41b9-8c92-0f23840a2f53 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.561269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc1446-d74d-41b9-8c92-0f23840a2f53 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.561684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc1446-d74d-41b9-8c92-0f23840a2f53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.563517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc1446-d74d-41b9-8c92-0f23840a2f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.565004 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc1446-d74d-41b9-8c92-0f23840a2f53 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.571346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 150/296] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:19.571346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beb7d9-d340-4681-a479-429544de590f None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.571346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beb7d9-d340-4681-a479-429544de590f None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.571346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beb7d9-d340-4681-a479-429544de590f None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.574332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 151/297] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:19.575234 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beb7d9-d340-4681-a479-429544de590f None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.627169 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faffd6c-b96a-4af4-af23-4d7540cc82ce None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.663858 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331981b-8626-4899-9a50-09b1c6253da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.665116 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331981b-8626-4899-9a50-09b1c6253da5 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.665404 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331981b-8626-4899-9a50-09b1c6253da5 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.665685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331981b-8626-4899-9a50-09b1c6253da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.666917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331981b-8626-4899-9a50-09b1c6253da5 None admin] RBAC: Adding query filter params (role.id=209cb6e49795432bb796352cec30474f, scope.project.id=36e5f01822474e888f237e6000a33a94, user.id=981157e6fd57442ba9e70536d2576d43) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:19.667229 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331981b-8626-4899-9a50-09b1c6253da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.669024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331981b-8626-4899-9a50-09b1c6253da5 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.676024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 147/298] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/role_assignments?user.id=981157e6fd57442ba9e70536d2576d43&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=209cb6e49795432bb796352cec30474f => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:19.677208 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f41139-1cdd-469b-8123-a554f42f7eee None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.677500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f41139-1cdd-469b-8123-a554f42f7eee None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.677779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f41139-1cdd-469b-8123-a554f42f7eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.698289 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-67f41139-1cdd-469b-8123-a554f42f7eee None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:19.699571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-67f41139-1cdd-469b-8123-a554f42f7eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:19.705014 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beb7d9-d340-4681-a479-429544de590f None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:19.757198 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d059b3-1f78-45a8-ae67-95983c23f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:19.758788 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d059b3-1f78-45a8-ae67-95983c23f66e None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.759297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d059b3-1f78-45a8-ae67-95983c23f66e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.759772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d059b3-1f78-45a8-ae67-95983c23f66e None admin] PATH_INFO: `/v3/groups` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.760678 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d059b3-1f78-45a8-ae67-95983c23f66e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:19.763428 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d059b3-1f78-45a8-ae67-95983c23f66e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:19.784751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 152/299] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Jun 25 20:35:19 2022] POST /identity/v3/groups => generated 229 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:19.785300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 148/300] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:19.786901 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d2d9c-a563-43a0-b7d3-a67475729da2 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.787515 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d2d9c-a563-43a0-b7d3-a67475729da2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.788034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d2d9c-a563-43a0-b7d3-a67475729da2 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.789734 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 153/301] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:19.800185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8511-eb37-496c-a7f3-7ac8eb49c3c7 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:19.800541 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8511-eb37-496c-a7f3-7ac8eb49c3c7 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:19.800737 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b8511-eb37-496c-a7f3-7ac8eb49c3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:19.813635 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d2d9c-a563-43a0-b7d3-a67475729da2 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.823174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-bd8b8511-eb37-496c-a7f3-7ac8eb49c3c7 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:19.824388 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-bd8b8511-eb37-496c-a7f3-7ac8eb49c3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:19.885681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.891036 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:19.954526 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 149/302] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:19.983522 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b8511-eb37-496c-a7f3-7ac8eb49c3c7 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:19.996039 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d2d9c-a563-43a0-b7d3-a67475729da2 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.039708 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a05762-e3cb-4969-a4d6-c1ee48400af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.040984 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a05762-e3cb-4969-a4d6-c1ee48400af9 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.041508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a05762-e3cb-4969-a4d6-c1ee48400af9 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.041996 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a05762-e3cb-4969-a4d6-c1ee48400af9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.062630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a05762-e3cb-4969-a4d6-c1ee48400af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e3a05762-e3cb-4969-a4d6-c1ee48400af9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:20.071183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:20.072059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:20.072848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:20.075606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 154/303] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:20.081404 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a05762-e3cb-4969-a4d6-c1ee48400af9 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.127042 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b8511-eb37-496c-a7f3-7ac8eb49c3c7 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.169222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc9a6d-8b86-462f-bc9d-b4e774522549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.170052 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc9a6d-8b86-462f-bc9d-b4e774522549 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.170398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc9a6d-8b86-462f-bc9d-b4e774522549 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.170791 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc9a6d-8b86-462f-bc9d-b4e774522549 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.184992 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc9a6d-8b86-462f-bc9d-b4e774522549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:20.193002 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-5cbc9a6d-8b86-462f-bc9d-b4e774522549 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:20.196965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:20.198077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:20.199294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 150/304] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:20.200520 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a05762-e3cb-4969-a4d6-c1ee48400af9 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.206298 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc9a6d-8b86-462f-bc9d-b4e774522549 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.242610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24a6b4-c5d0-409b-b7d9-5e173a1b93ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.243372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24a6b4-c5d0-409b-b7d9-5e173a1b93ef None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.243658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24a6b4-c5d0-409b-b7d9-5e173a1b93ef None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.243941 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24a6b4-c5d0-409b-b7d9-5e173a1b93ef None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.244770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24a6b4-c5d0-409b-b7d9-5e173a1b93ef None admin] RBAC: Adding query filter params (name=reader) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:20.245014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:20.245116 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24a6b4-c5d0-409b-b7d9-5e173a1b93ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.246631 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24a6b4-c5d0-409b-b7d9-5e173a1b93ef None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.256975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 155/305] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:20.263979 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24a6b4-c5d0-409b-b7d9-5e173a1b93ef None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.340674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc9a6d-8b86-462f-bc9d-b4e774522549 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.380242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24a6b4-c5d0-409b-b7d9-5e173a1b93ef None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.386319 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbc935-f488-4de6-bf54-6dbf6a6abb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.387028 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc935-f488-4de6-bf54-6dbf6a6abb57 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.387316 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc935-f488-4de6-bf54-6dbf6a6abb57 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.388104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbc935-f488-4de6-bf54-6dbf6a6abb57 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.388868 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbc935-f488-4de6-bf54-6dbf6a6abb57 None admin] RBAC: Adding query filter params (name=member) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:20.389222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbc935-f488-4de6-bf54-6dbf6a6abb57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.391170 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbc935-f488-4de6-bf54-6dbf6a6abb57 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.403263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 151/306] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:20.408912 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbc935-f488-4de6-bf54-6dbf6a6abb57 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.418795 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec569e1-7a98-4e9e-b308-b547d391f0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.419791 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec569e1-7a98-4e9e-b308-b547d391f0f7 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.420023 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec569e1-7a98-4e9e-b308-b547d391f0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.420304 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec569e1-7a98-4e9e-b308-b547d391f0f7 None admin] PATH_INFO: `/v3/users/2783fb314934471cb91b070ee6e46087` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.434989 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec569e1-7a98-4e9e-b308-b547d391f0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=2783fb314934471cb91b070ee6e46087)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.436487 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec569e1-7a98-4e9e-b308-b547d391f0f7 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.438843 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 156/307] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:20 2022] GET /identity/v3/users/2783fb314934471cb91b070ee6e46087 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:20.445670 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec569e1-7a98-4e9e-b308-b547d391f0f7 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.470373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:20.508121 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:20.527129 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbc935-f488-4de6-bf54-6dbf6a6abb57 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.563256 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec569e1-7a98-4e9e-b308-b547d391f0f7 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.563995 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6af03a-7404-4b3c-992f-daf709d1afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.564971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6af03a-7404-4b3c-992f-daf709d1afb3 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.565143 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6af03a-7404-4b3c-992f-daf709d1afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.565414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6af03a-7404-4b3c-992f-daf709d1afb3 None admin] PATH_INFO: `/v3/users/d7223e44e01944979f8425d33abfc667` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.566862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6af03a-7404-4b3c-992f-daf709d1afb3 None admin] RBAC: Authorizing `identity:get_user(user_id=d7223e44e01944979f8425d33abfc667)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.568073 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6af03a-7404-4b3c-992f-daf709d1afb3 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.569861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 152/308] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:20 2022] GET /identity/v3/users/d7223e44e01944979f8425d33abfc667 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:20.570894 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334b5ac-fbcb-447f-ae59-7cd42791d129 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.571178 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334b5ac-fbcb-447f-ae59-7cd42791d129 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.571452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334b5ac-fbcb-447f-ae59-7cd42791d129 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.572646 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 153/309] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:20.575518 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334b5ac-fbcb-447f-ae59-7cd42791d129 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.605978 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fbcb0-6f90-4d6a-93ee-465dd7f128ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.606826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fbcb0-6f90-4d6a-93ee-465dd7f128ad None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.607116 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fbcb0-6f90-4d6a-93ee-465dd7f128ad None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.607396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fbcb0-6f90-4d6a-93ee-465dd7f128ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.608223 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fbcb0-6f90-4d6a-93ee-465dd7f128ad None admin] RBAC: Adding query filter params (role.id=a6ec97dc5f284af19eeca47e8f257622, user.id=2783fb314934471cb91b070ee6e46087, scope.system=all) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:20.608550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fbcb0-6f90-4d6a-93ee-465dd7f128ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.610069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fbcb0-6f90-4d6a-93ee-465dd7f128ad None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.616224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 157/310] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Jun 25 20:35:20 2022] GET /identity/v3/role_assignments?user.id=2783fb314934471cb91b070ee6e46087&scope.system=all&role.id=a6ec97dc5f284af19eeca47e8f257622 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:20.616224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3e738-27ae-4c28-ba92-32c8fcfccf16 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.616224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3e738-27ae-4c28-ba92-32c8fcfccf16 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.616224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3e738-27ae-4c28-ba92-32c8fcfccf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.636534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-24e3e738-27ae-4c28-ba92-32c8fcfccf16 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:20.637366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-24e3e738-27ae-4c28-ba92-32c8fcfccf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:20.711068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334b5ac-fbcb-447f-ae59-7cd42791d129 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.726067 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 158/311] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:20.750973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1443d-cf2c-4d98-a35a-3e359d05a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.751903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1443d-cf2c-4d98-a35a-3e359d05a652 None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.752184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1443d-cf2c-4d98-a35a-3e359d05a652 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.752458 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1443d-cf2c-4d98-a35a-3e359d05a652 None admin] PATH_INFO: `/v3/system/users/d7223e44e01944979f8425d33abfc667/roles/209cb6e49795432bb796352cec30474f` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.754093 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1443d-cf2c-4d98-a35a-3e359d05a652 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d7223e44e01944979f8425d33abfc667, role_id=209cb6e49795432bb796352cec30474f)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:20.754496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3e738-27ae-4c28-ba92-32c8fcfccf16 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.755659 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1443d-cf2c-4d98-a35a-3e359d05a652 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:20.767751 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 154/312] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Jun 25 20:35:20 2022] PUT /identity/v3/system/users/d7223e44e01944979f8425d33abfc667/roles/209cb6e49795432bb796352cec30474f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:20.769676 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:20.883760 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3e738-27ae-4c28-ba92-32c8fcfccf16 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:20.926035 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be389393-c085-4c5d-bcd7-aac1a532e0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:20.927738 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be389393-c085-4c5d-bcd7-aac1a532e0dd None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:20.928412 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be389393-c085-4c5d-bcd7-aac1a532e0dd None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:20.928838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be389393-c085-4c5d-bcd7-aac1a532e0dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:20.942603 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be389393-c085-4c5d-bcd7-aac1a532e0dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-be389393-c085-4c5d-bcd7-aac1a532e0dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:20.951080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:20.952243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:20.953279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:20.955415 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 159/313] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:20.961450 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1443d-cf2c-4d98-a35a-3e359d05a652 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:20.986659 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:21.073675 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1443d-cf2c-4d98-a35a-3e359d05a652 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.108199 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec81f9-5c7b-4de3-a81a-9debffdf3486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.108939 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec81f9-5c7b-4de3-a81a-9debffdf3486 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.109315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec81f9-5c7b-4de3-a81a-9debffdf3486 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.109612 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec81f9-5c7b-4de3-a81a-9debffdf3486 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.110329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec81f9-5c7b-4de3-a81a-9debffdf3486 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:21.110656 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec81f9-5c7b-4de3-a81a-9debffdf3486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:21.112122 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec81f9-5c7b-4de3-a81a-9debffdf3486 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:21.121082 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 155/314] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:21.126650 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be389393-c085-4c5d-bcd7-aac1a532e0dd None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:21.209321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:21.243654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be389393-c085-4c5d-bcd7-aac1a532e0dd None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.279233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3146-ec0f-42cc-9e7d-2a7552212d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.280108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3146-ec0f-42cc-9e7d-2a7552212d14 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.280386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3146-ec0f-42cc-9e7d-2a7552212d14 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.280700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a3146-ec0f-42cc-9e7d-2a7552212d14 None admin] PATH_INFO: `/v3/users/6ec82353b0c74ed18834b0acefffad95` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.282001 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a3146-ec0f-42cc-9e7d-2a7552212d14 None admin] RBAC: Authorizing `identity:get_user(user_id=6ec82353b0c74ed18834b0acefffad95)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:21.283527 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a3146-ec0f-42cc-9e7d-2a7552212d14 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:21.285163 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 160/315] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:21 2022] GET /identity/v3/users/6ec82353b0c74ed18834b0acefffad95 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:21.290915 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec81f9-5c7b-4de3-a81a-9debffdf3486 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:21.375393 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:21.400414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec81f9-5c7b-4de3-a81a-9debffdf3486 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.435334 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d03ff-f21d-463c-a48b-81c3efedad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.435984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d03ff-f21d-463c-a48b-81c3efedad4d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.436269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d03ff-f21d-463c-a48b-81c3efedad4d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.436547 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d03ff-f21d-463c-a48b-81c3efedad4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.506496 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d03ff-f21d-463c-a48b-81c3efedad4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:21.507898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d03ff-f21d-463c-a48b-81c3efedad4d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:21.588697 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:21.611472 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 156/316] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:21.623520 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3146-ec0f-42cc-9e7d-2a7552212d14 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:21.729547 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a3146-ec0f-42cc-9e7d-2a7552212d14 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.764581 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb69e0c2-c646-4125-b48e-df8a3ee90e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.765551 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e0c2-c646-4125-b48e-df8a3ee90e2c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.765843 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e0c2-c646-4125-b48e-df8a3ee90e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.766112 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb69e0c2-c646-4125-b48e-df8a3ee90e2c None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.767343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69e0c2-c646-4125-b48e-df8a3ee90e2c None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:21.768823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb69e0c2-c646-4125-b48e-df8a3ee90e2c None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:21.770911 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 161/317] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:21 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:21.776640 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d03ff-f21d-463c-a48b-81c3efedad4d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:21.886514 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d03ff-f21d-463c-a48b-81c3efedad4d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:21.920899 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a367e7f9-8a29-4db0-835f-aead404eb02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:21.921617 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e7f9-8a29-4db0-835f-aead404eb02d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:21.921941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e7f9-8a29-4db0-835f-aead404eb02d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:21.922211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a367e7f9-8a29-4db0-835f-aead404eb02d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:21.923031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e7f9-8a29-4db0-835f-aead404eb02d None admin] RBAC: Adding query filter params (role.id=a6ec97dc5f284af19eeca47e8f257622, scope.project.id=36e5f01822474e888f237e6000a33a94, user.id=6ec82353b0c74ed18834b0acefffad95) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:21.923344 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e7f9-8a29-4db0-835f-aead404eb02d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:21.924808 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a367e7f9-8a29-4db0-835f-aead404eb02d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:21.931617 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 157/318] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:21 2022] GET /identity/v3/role_assignments?user.id=6ec82353b0c74ed18834b0acefffad95&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=a6ec97dc5f284af19eeca47e8f257622 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:22.376547 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57df27-0853-4949-be23-f3fda01cda70 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.377089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57df27-0853-4949-be23-f3fda01cda70 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.377089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57df27-0853-4949-be23-f3fda01cda70 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.378642 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 162/319] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:22.383693 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01807b1-0e63-4429-82b9-64361c4aa034 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.384097 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01807b1-0e63-4429-82b9-64361c4aa034 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.384201 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01807b1-0e63-4429-82b9-64361c4aa034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.401804 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-c01807b1-0e63-4429-82b9-64361c4aa034 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:22.403034 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-c01807b1-0e63-4429-82b9-64361c4aa034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:22.446218 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:22.475172 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 158/320] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:22.498576 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57df27-0853-4949-be23-f3fda01cda70 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:22.509309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:22.607248 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57df27-0853-4949-be23-f3fda01cda70 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:22.641944 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbbc5aa-302c-48d0-b65a-9c0889f197f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:22.642682 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbc5aa-302c-48d0-b65a-9c0889f197f3 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.642963 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbc5aa-302c-48d0-b65a-9c0889f197f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.643257 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbbc5aa-302c-48d0-b65a-9c0889f197f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.644413 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbc5aa-302c-48d0-b65a-9c0889f197f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:22.645879 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbbc5aa-302c-48d0-b65a-9c0889f197f3 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:22.647734 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 163/321] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:22.653144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01807b1-0e63-4429-82b9-64361c4aa034 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:22.760220 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01807b1-0e63-4429-82b9-64361c4aa034 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:22.796408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a67c9-3b91-4868-9712-c7e3dcdd5e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:22.797116 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a67c9-3b91-4868-9712-c7e3dcdd5e40 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:22.797580 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a67c9-3b91-4868-9712-c7e3dcdd5e40 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:22.797859 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a67c9-3b91-4868-9712-c7e3dcdd5e40 None admin] PATH_INFO: `/v3/groups` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:22.798613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a67c9-3b91-4868-9712-c7e3dcdd5e40 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:22.800126 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a67c9-3b91-4868-9712-c7e3dcdd5e40 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:22.818302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 159/322] 10.222.0.26 () {60 vars in 1134 bytes} [Sat Jun 25 20:35:22 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:23.036510 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5dc8e-9377-4216-b0a0-1c33f63b0db0 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.036797 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5dc8e-9377-4216-b0a0-1c33f63b0db0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.037077 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5dc8e-9377-4216-b0a0-1c33f63b0db0 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.038662 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 164/323] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:23.044208 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff8e7b-5d06-449a-abca-f9203f4148a9 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.044499 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff8e7b-5d06-449a-abca-f9203f4148a9 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.044778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff8e7b-5d06-449a-abca-f9203f4148a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.062224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-11ff8e7b-5d06-449a-abca-f9203f4148a9 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:23.063841 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-11ff8e7b-5d06-449a-abca-f9203f4148a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:23.091882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.137291 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 160/324] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:23.147648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f715b71-0c04-4ba6-8327-38e95437a58a None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.148301 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f715b71-0c04-4ba6-8327-38e95437a58a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.148768 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f715b71-0c04-4ba6-8327-38e95437a58a None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.150577 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 165/325] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:23.155583 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7e2d9-5418-441f-84bf-dd55bcb4b6f3 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.155919 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7e2d9-5418-441f-84bf-dd55bcb4b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.156201 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7e2d9-5418-441f-84bf-dd55bcb4b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.162402 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f715b71-0c04-4ba6-8327-38e95437a58a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.174190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-4bf7e2d9-5418-441f-84bf-dd55bcb4b6f3 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:23.175417 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-4bf7e2d9-5418-441f-84bf-dd55bcb4b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:23.251102 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 161/326] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:23.271316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.277198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7e2d9-5418-441f-84bf-dd55bcb4b6f3 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.304767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f715b71-0c04-4ba6-8327-38e95437a58a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.350185 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10c07c-0d9e-4a4d-92cd-83d0e5a14182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.351166 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10c07c-0d9e-4a4d-92cd-83d0e5a14182 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.351568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10c07c-0d9e-4a4d-92cd-83d0e5a14182 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.351938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10c07c-0d9e-4a4d-92cd-83d0e5a14182 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.365884 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10c07c-0d9e-4a4d-92cd-83d0e5a14182 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-bd10c07c-0d9e-4a4d-92cd-83d0e5a14182 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:23.373954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:23.375125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:23.375938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 166/327] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:23.381263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10c07c-0d9e-4a4d-92cd-83d0e5a14182 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.406242 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.417815 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7e2d9-5418-441f-84bf-dd55bcb4b6f3 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.465681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1552fa-90b9-4bb7-92d9-ad7b2ae26042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.466861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1552fa-90b9-4bb7-92d9-ad7b2ae26042 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.467289 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1552fa-90b9-4bb7-92d9-ad7b2ae26042 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.467706 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1552fa-90b9-4bb7-92d9-ad7b2ae26042 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.482584 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1552fa-90b9-4bb7-92d9-ad7b2ae26042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-cb1552fa-90b9-4bb7-92d9-ad7b2ae26042 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:23.493296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:23.494387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:23.495269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:23.497797 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 162/328] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:23.504454 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10c07c-0d9e-4a4d-92cd-83d0e5a14182 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.505774 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1552fa-90b9-4bb7-92d9-ad7b2ae26042 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.556667 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be614bf2-a765-434c-b044-c20e9970cc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.557679 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be614bf2-a765-434c-b044-c20e9970cc94 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.558747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be614bf2-a765-434c-b044-c20e9970cc94 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.559200 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be614bf2-a765-434c-b044-c20e9970cc94 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.560165 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be614bf2-a765-434c-b044-c20e9970cc94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:23.560640 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be614bf2-a765-434c-b044-c20e9970cc94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:23.562459 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be614bf2-a765-434c-b044-c20e9970cc94 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:23.564788 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.576739 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 167/329] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:23.586079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be614bf2-a765-434c-b044-c20e9970cc94 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.661809 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1552fa-90b9-4bb7-92d9-ad7b2ae26042 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.713954 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621f110-b785-4305-a5ee-b2202e269414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.715333 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621f110-b785-4305-a5ee-b2202e269414 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.715690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621f110-b785-4305-a5ee-b2202e269414 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.716720 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621f110-b785-4305-a5ee-b2202e269414 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.717576 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621f110-b785-4305-a5ee-b2202e269414 None admin] RBAC: Adding query filter params (name=member) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:23.718536 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621f110-b785-4305-a5ee-b2202e269414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:23.722459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621f110-b785-4305-a5ee-b2202e269414 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:23.736878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be614bf2-a765-434c-b044-c20e9970cc94 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.737696 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 163/330] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:23.744151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621f110-b785-4305-a5ee-b2202e269414 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.766709 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.795297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631b397-3482-49d7-86aa-ca88097414a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.796537 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631b397-3482-49d7-86aa-ca88097414a8 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.796964 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631b397-3482-49d7-86aa-ca88097414a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.797370 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631b397-3482-49d7-86aa-ca88097414a8 None admin] PATH_INFO: `/v3/users/2783fb314934471cb91b070ee6e46087` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.799229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631b397-3482-49d7-86aa-ca88097414a8 None admin] RBAC: Authorizing `identity:get_user(user_id=2783fb314934471cb91b070ee6e46087)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:23.801589 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631b397-3482-49d7-86aa-ca88097414a8 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:23.804543 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 168/331] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/users/2783fb314934471cb91b070ee6e46087 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:23.810722 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631b397-3482-49d7-86aa-ca88097414a8 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.862965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621f110-b785-4305-a5ee-b2202e269414 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.881102 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:23.900924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c315e6-88e1-4795-aad9-5c7a530e64bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.901961 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c315e6-88e1-4795-aad9-5c7a530e64bb None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.902345 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c315e6-88e1-4795-aad9-5c7a530e64bb None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.902740 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c315e6-88e1-4795-aad9-5c7a530e64bb None admin] PATH_INFO: `/v3/users/d7223e44e01944979f8425d33abfc667` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.904841 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c315e6-88e1-4795-aad9-5c7a530e64bb None admin] RBAC: Authorizing `identity:get_user(user_id=d7223e44e01944979f8425d33abfc667)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:23.907156 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c315e6-88e1-4795-aad9-5c7a530e64bb None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:23.909293 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 164/332] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/users/d7223e44e01944979f8425d33abfc667 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:23.915260 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c315e6-88e1-4795-aad9-5c7a530e64bb None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:23.926440 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631b397-3482-49d7-86aa-ca88097414a8 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:23.971360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41a7de-123a-43f1-8c0f-16dc83934c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:23.973564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41a7de-123a-43f1-8c0f-16dc83934c2b None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:23.976724 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41a7de-123a-43f1-8c0f-16dc83934c2b None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:23.977209 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41a7de-123a-43f1-8c0f-16dc83934c2b None admin] PATH_INFO: `/v3/system/users/2783fb314934471cb91b070ee6e46087/roles/a6ec97dc5f284af19eeca47e8f257622` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:23.979522 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41a7de-123a-43f1-8c0f-16dc83934c2b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2783fb314934471cb91b070ee6e46087, role_id=a6ec97dc5f284af19eeca47e8f257622)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:23.981075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41a7de-123a-43f1-8c0f-16dc83934c2b None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:24.000447 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 169/333] 10.222.0.26 () {58 vars in 1334 bytes} [Sat Jun 25 20:35:23 2022] PUT /identity/v3/system/users/2783fb314934471cb91b070ee6e46087/roles/a6ec97dc5f284af19eeca47e8f257622 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:35:24.049425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:24.068019 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c315e6-88e1-4795-aad9-5c7a530e64bb None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:24.105885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828fd09-9599-4aff-9871-e5c1982e44e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:24.106836 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828fd09-9599-4aff-9871-e5c1982e44e9 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:24.107299 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828fd09-9599-4aff-9871-e5c1982e44e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:24.107714 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828fd09-9599-4aff-9871-e5c1982e44e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:24.108735 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828fd09-9599-4aff-9871-e5c1982e44e9 None admin] RBAC: Adding query filter params (role.id=209cb6e49795432bb796352cec30474f, user.id=d7223e44e01944979f8425d33abfc667, scope.system=all) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:24.109310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828fd09-9599-4aff-9871-e5c1982e44e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:24.111343 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828fd09-9599-4aff-9871-e5c1982e44e9 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:24.125149 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 165/334] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Jun 25 20:35:23 2022] GET /identity/v3/role_assignments?user.id=d7223e44e01944979f8425d33abfc667&scope.system=all&role.id=209cb6e49795432bb796352cec30474f => generated 510 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:26.634371 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86577a8-13e7-410c-b511-8e0c3c5f6b54 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.635478 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86577a8-13e7-410c-b511-8e0c3c5f6b54 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.636324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86577a8-13e7-410c-b511-8e0c3c5f6b54 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.637964 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 170/335] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:26.644222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca99ff5-4b2c-49f8-8915-b1f5cdb68f01 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.644730 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca99ff5-4b2c-49f8-8915-b1f5cdb68f01 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.644811 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca99ff5-4b2c-49f8-8915-b1f5cdb68f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.666062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-7ca99ff5-4b2c-49f8-8915-b1f5cdb68f01 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:26.667290 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-7ca99ff5-4b2c-49f8-8915-b1f5cdb68f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:26.761467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 166/336] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:26.812744 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86577a8-13e7-410c-b511-8e0c3c5f6b54 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:26.831543 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3f32b-c19b-481f-8716-ed291fda2e0d None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.831872 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3f32b-c19b-481f-8716-ed291fda2e0d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.832106 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3f32b-c19b-481f-8716-ed291fda2e0d None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.835475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 167/337] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:26.838561 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9df3de-4e4c-4247-918c-3c5ae13ceec3 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:26.838848 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9df3de-4e4c-4247-918c-3c5ae13ceec3 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:26.839126 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9df3de-4e4c-4247-918c-3c5ae13ceec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:26.867478 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-1c9df3de-4e4c-4247-918c-3c5ae13ceec3 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:26.868685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-1c9df3de-4e4c-4247-918c-3c5ae13ceec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:27.009507 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86577a8-13e7-410c-b511-8e0c3c5f6b54 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.028129 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 168/338] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:27.061215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b92880-c38e-44f9-b99a-e6a7a7d43588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.062227 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b92880-c38e-44f9-b99a-e6a7a7d43588 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.062227 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b92880-c38e-44f9-b99a-e6a7a7d43588 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.062933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b92880-c38e-44f9-b99a-e6a7a7d43588 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.072489 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.073139 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9df3de-4e4c-4247-918c-3c5ae13ceec3 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.075630 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.087845 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b92880-c38e-44f9-b99a-e6a7a7d43588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-50b92880-c38e-44f9-b99a-e6a7a7d43588 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:27.097270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:27.098245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:27.099686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 171/339] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:27.107732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b92880-c38e-44f9-b99a-e6a7a7d43588 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.229908 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b92880-c38e-44f9-b99a-e6a7a7d43588 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.271675 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d4be2-3316-4ba8-88cf-d37879d61d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.272356 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d4be2-3316-4ba8-88cf-d37879d61d4f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.272643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d4be2-3316-4ba8-88cf-d37879d61d4f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.273457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d4be2-3316-4ba8-88cf-d37879d61d4f None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.274219 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d4be2-3316-4ba8-88cf-d37879d61d4f None admin] RBAC: Adding query filter params (name=member) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:27.274908 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d4be2-3316-4ba8-88cf-d37879d61d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.276970 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d4be2-3316-4ba8-88cf-d37879d61d4f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.285804 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9df3de-4e4c-4247-918c-3c5ae13ceec3 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.289838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 172/340] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:27.291229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cb56e-ac97-4dbf-a940-d6f74b4c10b2 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.291518 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cb56e-ac97-4dbf-a940-d6f74b4c10b2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.291798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1cb56e-ac97-4dbf-a940-d6f74b4c10b2 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.293037 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 173/341] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:27.294094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe554fbd-05b1-40a7-997b-e0a802b6b9b0 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.294379 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe554fbd-05b1-40a7-997b-e0a802b6b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.298780 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe554fbd-05b1-40a7-997b-e0a802b6b9b0 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.300321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 174/342] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:27.300881 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe554fbd-05b1-40a7-997b-e0a802b6b9b0 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.345924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d0762-158c-4671-a56c-f6e8e2f73f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.347120 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0762-158c-4671-a56c-f6e8e2f73f16 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.347988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0762-158c-4671-a56c-f6e8e2f73f16 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.348281 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d0762-158c-4671-a56c-f6e8e2f73f16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.365073 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d0762-158c-4671-a56c-f6e8e2f73f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:27.372255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-f23d0762-158c-4671-a56c-f6e8e2f73f16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:27.377280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:27.379305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:27.380681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 169/343] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:27.383081 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652d07-e623-40ad-9380-1e00e6643c9a None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.383081 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652d07-e623-40ad-9380-1e00e6643c9a None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.383081 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85652d07-e623-40ad-9380-1e00e6643c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.407563 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-85652d07-e623-40ad-9380-1e00e6643c9a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:27.408850 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-85652d07-e623-40ad-9380-1e00e6643c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:27.440481 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe554fbd-05b1-40a7-997b-e0a802b6b9b0 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.489748 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.497265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b27d7-c3f7-4b8e-af09-ca4ce1f2e10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.497940 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b27d7-c3f7-4b8e-af09-ca4ce1f2e10a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.498224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b27d7-c3f7-4b8e-af09-ca4ce1f2e10a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.498557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b27d7-c3f7-4b8e-af09-ca4ce1f2e10a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.506012 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 170/344] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:27.507731 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218b67-c6ee-46ed-a8aa-b8603bc20a2c None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.508259 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218b67-c6ee-46ed-a8aa-b8603bc20a2c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.508748 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218b67-c6ee-46ed-a8aa-b8603bc20a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.526244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-f2218b67-c6ee-46ed-a8aa-b8603bc20a2c None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:27.527864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-f2218b67-c6ee-46ed-a8aa-b8603bc20a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:27.598285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b27d7-c3f7-4b8e-af09-ca4ce1f2e10a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.599909 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b27d7-c3f7-4b8e-af09-ca4ce1f2e10a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.601689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 171/345] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:27.602406 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2218b67-c6ee-46ed-a8aa-b8603bc20a2c None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.652176 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.715328 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 175/346] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:27.715856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2218b67-c6ee-46ed-a8aa-b8603bc20a2c None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.716294 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b27d7-c3f7-4b8e-af09-ca4ce1f2e10a None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.741416 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.755597 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d7338-e2ae-4453-8486-9f643826cd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.756129 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d7338-e2ae-4453-8486-9f643826cd9d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.756473 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d7338-e2ae-4453-8486-9f643826cd9d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.756813 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d7338-e2ae-4453-8486-9f643826cd9d None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.757629 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d7338-e2ae-4453-8486-9f643826cd9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:27.758354 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d7338-e2ae-4453-8486-9f643826cd9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:27.759358 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d7338-e2ae-4453-8486-9f643826cd9d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:27.770734 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 172/347] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:27.772882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd148e-d81f-4edc-b226-6ebe89b7f71b None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.773388 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd148e-d81f-4edc-b226-6ebe89b7f71b None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.774051 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd148e-d81f-4edc-b226-6ebe89b7f71b None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.776597 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 173/348] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:27.778324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd148e-d81f-4edc-b226-6ebe89b7f71b None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.848419 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b27d7-c3f7-4b8e-af09-ca4ce1f2e10a None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.889040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2aa64-6e19-4195-b810-ce49033fae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.889874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2aa64-6e19-4195-b810-ce49033fae38 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.890278 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2aa64-6e19-4195-b810-ce49033fae38 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.890913 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2aa64-6e19-4195-b810-ce49033fae38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.906083 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd148e-d81f-4edc-b226-6ebe89b7f71b None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:27.907883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2aa64-6e19-4195-b810-ce49033fae38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-d8d2aa64-6e19-4195-b810-ce49033fae38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:27.917448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:27.918358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:27.919239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 176/349] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:27.919977 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87100a85-fc70-43c3-baf7-c9236b6e8ab6 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.920542 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87100a85-fc70-43c3-baf7-c9236b6e8ab6 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.920542 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87100a85-fc70-43c3-baf7-c9236b6e8ab6 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.921872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 177/350] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:27.922693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87100a85-fc70-43c3-baf7-c9236b6e8ab6 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:27.939834 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:27.950206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c937cc-3623-4eb7-90ed-e143f6a22833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:27.951062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c937cc-3623-4eb7-90ed-e143f6a22833 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:27.951346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c937cc-3623-4eb7-90ed-e143f6a22833 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:27.951629 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c937cc-3623-4eb7-90ed-e143f6a22833 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:27.965410 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c937cc-3623-4eb7-90ed-e143f6a22833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-b3c937cc-3623-4eb7-90ed-e143f6a22833 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:27.974471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:27.975372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 174/351] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:27.976185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c937cc-3623-4eb7-90ed-e143f6a22833 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.036385 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.053016 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87100a85-fc70-43c3-baf7-c9236b6e8ab6 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.089097 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb27181-3d71-4896-a4a7-ce50b49c473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.090052 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb27181-3d71-4896-a4a7-ce50b49c473a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.090457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb27181-3d71-4896-a4a7-ce50b49c473a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.090738 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb27181-3d71-4896-a4a7-ce50b49c473a None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.091953 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb27181-3d71-4896-a4a7-ce50b49c473a None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.093781 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb27181-3d71-4896-a4a7-ce50b49c473a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.095764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 178/352] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.096726 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcfe47-b248-48db-a972-d1f6eee33bd1 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.097015 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcfe47-b248-48db-a972-d1f6eee33bd1 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.097297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfcfe47-b248-48db-a972-d1f6eee33bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.105470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c937cc-3623-4eb7-90ed-e143f6a22833 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.115465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-1dfcfe47-b248-48db-a972-d1f6eee33bd1 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:28.116686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-1dfcfe47-b248-48db-a972-d1f6eee33bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:28.148135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ca32-f361-4aaa-bae1-25918311cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.148788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ca32-f361-4aaa-bae1-25918311cf36 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.149070 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ca32-f361-4aaa-bae1-25918311cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.149347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ca32-f361-4aaa-bae1-25918311cf36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.194441 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 179/353] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:28.195775 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8f83d-06bf-45fe-bcd7-c93b51bcf9a2 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.196065 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8f83d-06bf-45fe-bcd7-c93b51bcf9a2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.197744 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8f83d-06bf-45fe-bcd7-c93b51bcf9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.214883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-c2e8f83d-06bf-45fe-bcd7-c93b51bcf9a2 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:28.216413 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-c2e8f83d-06bf-45fe-bcd7-c93b51bcf9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:28.219075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.231149 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15ca32-f361-4aaa-bae1-25918311cf36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.232630 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15ca32-f361-4aaa-bae1-25918311cf36 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.288256 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.296167 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 180/354] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:28.297404 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8f83d-06bf-45fe-bcd7-c93b51bcf9a2 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.352751 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 175/355] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:28.353715 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ca32-f361-4aaa-bae1-25918311cf36 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.414603 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8f83d-06bf-45fe-bcd7-c93b51bcf9a2 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.458152 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303b786-1f60-4f56-91e0-4439563672a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.458481 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303b786-1f60-4f56-91e0-4439563672a4 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.458775 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303b786-1f60-4f56-91e0-4439563672a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.459054 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303b786-1f60-4f56-91e0-4439563672a4 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.460886 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303b786-1f60-4f56-91e0-4439563672a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:28.460886 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303b786-1f60-4f56-91e0-4439563672a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.461623 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303b786-1f60-4f56-91e0-4439563672a4 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.469117 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.473243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 181/356] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.474109 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303b786-1f60-4f56-91e0-4439563672a4 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.478549 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ca32-f361-4aaa-bae1-25918311cf36 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.520895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e57e12-349b-4e72-a29d-fd05a26928a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.522380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e57e12-349b-4e72-a29d-fd05a26928a9 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.522380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e57e12-349b-4e72-a29d-fd05a26928a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.522380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e57e12-349b-4e72-a29d-fd05a26928a9 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.523039 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e57e12-349b-4e72-a29d-fd05a26928a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:28.523347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e57e12-349b-4e72-a29d-fd05a26928a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.524742 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e57e12-349b-4e72-a29d-fd05a26928a9 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.533402 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 176/357] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.534234 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e57e12-349b-4e72-a29d-fd05a26928a9 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.544240 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.600991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303b786-1f60-4f56-91e0-4439563672a4 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.643513 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f82ecc-c29c-43fd-8ea8-704154273819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.644490 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f82ecc-c29c-43fd-8ea8-704154273819 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.644771 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f82ecc-c29c-43fd-8ea8-704154273819 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.645037 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f82ecc-c29c-43fd-8ea8-704154273819 None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.651231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f82ecc-c29c-43fd-8ea8-704154273819 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.652708 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f82ecc-c29c-43fd-8ea8-704154273819 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.654385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 182/358] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.654955 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e57e12-349b-4e72-a29d-fd05a26928a9 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.655287 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f82ecc-c29c-43fd-8ea8-704154273819 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.698065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8980ef-4e27-4faa-b15d-aefb38d21578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.698929 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8980ef-4e27-4faa-b15d-aefb38d21578 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.699214 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8980ef-4e27-4faa-b15d-aefb38d21578 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.699490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8980ef-4e27-4faa-b15d-aefb38d21578 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.711486 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8980ef-4e27-4faa-b15d-aefb38d21578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-ed8980ef-4e27-4faa-b15d-aefb38d21578 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:28.719477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:28.720795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 177/359] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:28.721585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8980ef-4e27-4faa-b15d-aefb38d21578 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.732048 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.781816 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f82ecc-c29c-43fd-8ea8-704154273819 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.803591 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:28.823777 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc05c-10c3-43f1-b776-022f92d089c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.824586 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc05c-10c3-43f1-b776-022f92d089c2 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.824869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc05c-10c3-43f1-b776-022f92d089c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.825146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcc05c-10c3-43f1-b776-022f92d089c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.839404 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcc05c-10c3-43f1-b776-022f92d089c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-d8bcc05c-10c3-43f1-b776-022f92d089c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:28.848297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:28.849231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 183/360] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:28.850325 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc05c-10c3-43f1-b776-022f92d089c2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.858620 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8980ef-4e27-4faa-b15d-aefb38d21578 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:28.899389 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e342d3-1a6a-4e10-8502-fd1019bac725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:28.900376 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e342d3-1a6a-4e10-8502-fd1019bac725 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:28.900660 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e342d3-1a6a-4e10-8502-fd1019bac725 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:28.900938 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e342d3-1a6a-4e10-8502-fd1019bac725 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:28.902153 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e342d3-1a6a-4e10-8502-fd1019bac725 None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:28.903717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e342d3-1a6a-4e10-8502-fd1019bac725 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:28.905887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 178/361] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:28.906298 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e342d3-1a6a-4e10-8502-fd1019bac725 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:28.976564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcc05c-10c3-43f1-b776-022f92d089c2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.000601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.011496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134e3b1-1ecf-4e80-92ad-d606adf29c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.012157 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134e3b1-1ecf-4e80-92ad-d606adf29c0d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.012441 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134e3b1-1ecf-4e80-92ad-d606adf29c0d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.012738 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134e3b1-1ecf-4e80-92ad-d606adf29c0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.014831 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e342d3-1a6a-4e10-8502-fd1019bac725 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.049100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44424-4509-4766-8bbb-fad021080740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.049751 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44424-4509-4766-8bbb-fad021080740 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.050038 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44424-4509-4766-8bbb-fad021080740 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.050321 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a44424-4509-4766-8bbb-fad021080740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.053820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.081283 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134e3b1-1ecf-4e80-92ad-d606adf29c0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.082805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2134e3b1-1ecf-4e80-92ad-d606adf29c0d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.119729 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a44424-4509-4766-8bbb-fad021080740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.121214 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a44424-4509-4766-8bbb-fad021080740 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.180777 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 184/362] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:29.181617 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134e3b1-1ecf-4e80-92ad-d606adf29c0d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.205194 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.222314 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 179/363] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:29.223194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44424-4509-4766-8bbb-fad021080740 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.256721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.286476 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2134e3b1-1ecf-4e80-92ad-d606adf29c0d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.319676 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff7d1f-145c-4802-947f-86683dc09f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.320291 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff7d1f-145c-4802-947f-86683dc09f51 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.320577 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff7d1f-145c-4802-947f-86683dc09f51 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.320860 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff7d1f-145c-4802-947f-86683dc09f51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.322797 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff7d1f-145c-4802-947f-86683dc09f51 None admin] RBAC: Adding query filter params (group.id=d1dc1543fa3a4976b0b58bbacd9abd88, role.id=209cb6e49795432bb796352cec30474f, scope.project.id=848b8e76a38e4d9da24492efeec48f1a) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:29.323258 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff7d1f-145c-4802-947f-86683dc09f51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.324370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a44424-4509-4766-8bbb-fad021080740 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.324931 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff7d1f-145c-4802-947f-86683dc09f51 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.331681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 185/364] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/role_assignments?group.id=d1dc1543fa3a4976b0b58bbacd9abd88&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=209cb6e49795432bb796352cec30474f => generated 260 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:29.332301 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff7d1f-145c-4802-947f-86683dc09f51 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.378967 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a89863-e3f3-4618-bb31-496bb2a26252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.379653 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a89863-e3f3-4618-bb31-496bb2a26252 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.379940 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a89863-e3f3-4618-bb31-496bb2a26252 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.380219 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a89863-e3f3-4618-bb31-496bb2a26252 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.380960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a89863-e3f3-4618-bb31-496bb2a26252 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:29.381901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a89863-e3f3-4618-bb31-496bb2a26252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.383800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a89863-e3f3-4618-bb31-496bb2a26252 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.401115 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 180/365] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:29.401115 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a89863-e3f3-4618-bb31-496bb2a26252 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.437855 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.453986 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff7d1f-145c-4802-947f-86683dc09f51 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.492797 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5c5a3-24de-45aa-9a66-fee0a65724b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.493679 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5c5a3-24de-45aa-9a66-fee0a65724b4 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.493967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5c5a3-24de-45aa-9a66-fee0a65724b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.494254 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5c5a3-24de-45aa-9a66-fee0a65724b4 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.495065 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5c5a3-24de-45aa-9a66-fee0a65724b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:29.495385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5c5a3-24de-45aa-9a66-fee0a65724b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.496839 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5c5a3-24de-45aa-9a66-fee0a65724b4 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.506656 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 186/366] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:29.508055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5c5a3-24de-45aa-9a66-fee0a65724b4 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.533320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.541311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a89863-e3f3-4618-bb31-496bb2a26252 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.585099 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd68b0-cb26-42be-a0e8-a0e04b99b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.586641 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd68b0-cb26-42be-a0e8-a0e04b99b25d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.586970 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd68b0-cb26-42be-a0e8-a0e04b99b25d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.587295 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd68b0-cb26-42be-a0e8-a0e04b99b25d None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.588916 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd68b0-cb26-42be-a0e8-a0e04b99b25d None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.590404 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfd68b0-cb26-42be-a0e8-a0e04b99b25d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.597471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 181/367] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:29.597471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd68b0-cb26-42be-a0e8-a0e04b99b25d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.653887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5c5a3-24de-45aa-9a66-fee0a65724b4 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.695514 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf53b54-0776-4479-9567-453eadd487e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.696564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53b54-0776-4479-9567-453eadd487e2 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.697004 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53b54-0776-4479-9567-453eadd487e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.697283 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf53b54-0776-4479-9567-453eadd487e2 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.698561 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf53b54-0776-4479-9567-453eadd487e2 None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.700042 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf53b54-0776-4479-9567-453eadd487e2 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.702856 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 187/368] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:29.703513 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf53b54-0776-4479-9567-453eadd487e2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.725408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfd68b0-cb26-42be-a0e8-a0e04b99b25d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.732323 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.768180 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f786d-d4f4-4516-ad06-155c313c9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.769095 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f786d-d4f4-4516-ad06-155c313c9b36 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.769292 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f786d-d4f4-4516-ad06-155c313c9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.769596 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f786d-d4f4-4516-ad06-155c313c9b36 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.770967 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f786d-d4f4-4516-ad06-155c313c9b36 None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.772430 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f786d-d4f4-4516-ad06-155c313c9b36 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.774488 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 182/369] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:29.775302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f786d-d4f4-4516-ad06-155c313c9b36 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.819661 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:29.851472 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf53b54-0776-4479-9567-453eadd487e2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.898000 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdc0f0-8ecd-4718-b470-f282cc9f31a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.898723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc0f0-8ecd-4718-b470-f282cc9f31a3 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.899014 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc0f0-8ecd-4718-b470-f282cc9f31a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.899297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdc0f0-8ecd-4718-b470-f282cc9f31a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.904590 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f786d-d4f4-4516-ad06-155c313c9b36 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:29.954314 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324188e5-e982-4cc4-87c7-9a2fa97acd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:29.955234 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324188e5-e982-4cc4-87c7-9a2fa97acd6c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:29.955725 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324188e5-e982-4cc4-87c7-9a2fa97acd6c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:29.956009 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324188e5-e982-4cc4-87c7-9a2fa97acd6c None admin] PATH_INFO: `/v3/users/2783fb314934471cb91b070ee6e46087` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:29.957309 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324188e5-e982-4cc4-87c7-9a2fa97acd6c None admin] RBAC: Authorizing `identity:get_user(user_id=2783fb314934471cb91b070ee6e46087)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.958807 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324188e5-e982-4cc4-87c7-9a2fa97acd6c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:29.965357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 183/370] 10.222.0.26 () {56 vars in 1177 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/users/2783fb314934471cb91b070ee6e46087 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:29.965357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324188e5-e982-4cc4-87c7-9a2fa97acd6c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:29.986066 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdc0f0-8ecd-4718-b470-f282cc9f31a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:29.987599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdc0f0-8ecd-4718-b470-f282cc9f31a3 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:30.012843 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:30.084599 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:30.089585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324188e5-e982-4cc4-87c7-9a2fa97acd6c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:30.109535 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 188/371] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:30.111219 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdc0f0-8ecd-4718-b470-f282cc9f31a3 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:30.137540 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57366b4-f2d6-4318-9ef0-63095e6d6b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:30.138204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57366b4-f2d6-4318-9ef0-63095e6d6b08 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:30.138872 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57366b4-f2d6-4318-9ef0-63095e6d6b08 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:30.139221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57366b4-f2d6-4318-9ef0-63095e6d6b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:30.141064 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57366b4-f2d6-4318-9ef0-63095e6d6b08 None admin] RBAC: Adding query filter params (group.id=d1dc1543fa3a4976b0b58bbacd9abd88, role.id=85d95bf96f68469397338d49ad9fd8fa, scope.project.id=848b8e76a38e4d9da24492efeec48f1a) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:30.141554 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57366b4-f2d6-4318-9ef0-63095e6d6b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:30.142889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57366b4-f2d6-4318-9ef0-63095e6d6b08 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:30.150826 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 184/372] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:29 2022] GET /identity/v3/role_assignments?group.id=d1dc1543fa3a4976b0b58bbacd9abd88&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=85d95bf96f68469397338d49ad9fd8fa => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:30.159826 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57366b4-f2d6-4318-9ef0-63095e6d6b08 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:30.259860 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdc0f0-8ecd-4718-b470-f282cc9f31a3 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:30.284564 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57366b4-f2d6-4318-9ef0-63095e6d6b08 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:30.286550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:30.310969 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffa254-7f6f-4a4d-9d63-041ca3fd5072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:30.313015 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffa254-7f6f-4a4d-9d63-041ca3fd5072 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:30.313957 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffa254-7f6f-4a4d-9d63-041ca3fd5072 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:30.314449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffa254-7f6f-4a4d-9d63-041ca3fd5072 None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:30.316598 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffa254-7f6f-4a4d-9d63-041ca3fd5072 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:30.319249 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffa254-7f6f-4a4d-9d63-041ca3fd5072 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:30.321903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 189/373] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:30 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:30.323579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffa254-7f6f-4a4d-9d63-041ca3fd5072 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:30.327438 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ce1a3-7297-4e0f-8990-6732efa6389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:30.329163 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ce1a3-7297-4e0f-8990-6732efa6389b None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:30.329294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ce1a3-7297-4e0f-8990-6732efa6389b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:30.329516 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ce1a3-7297-4e0f-8990-6732efa6389b None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:30.330834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ce1a3-7297-4e0f-8990-6732efa6389b None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:30.332326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10ce1a3-7297-4e0f-8990-6732efa6389b None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:30.334230 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 185/374] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:30 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:30.339394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ce1a3-7297-4e0f-8990-6732efa6389b None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:30.380329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:30.453874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffa254-7f6f-4a4d-9d63-041ca3fd5072 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:30.491892 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ce1a3-7297-4e0f-8990-6732efa6389b None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:30.492877 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f257-e3db-498e-8da7-6ffdca3e0469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:30.494043 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f257-e3db-498e-8da7-6ffdca3e0469 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:30.495396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f257-e3db-498e-8da7-6ffdca3e0469 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:30.495893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b61f257-e3db-498e-8da7-6ffdca3e0469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:30.496912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f257-e3db-498e-8da7-6ffdca3e0469 None admin] RBAC: Adding query filter params (role.id=a6ec97dc5f284af19eeca47e8f257622, user.id=2783fb314934471cb91b070ee6e46087, scope.system=all) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:30.497413 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f257-e3db-498e-8da7-6ffdca3e0469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:30.499698 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b61f257-e3db-498e-8da7-6ffdca3e0469 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:30.522928 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 190/375] 10.222.0.26 () {56 vars in 1308 bytes} [Sat Jun 25 20:35:30 2022] GET /identity/v3/role_assignments?user.id=2783fb314934471cb91b070ee6e46087&scope.system=all&role.id=a6ec97dc5f284af19eeca47e8f257622 => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:30.524245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f257-e3db-498e-8da7-6ffdca3e0469 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:30.532689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac9c6-0972-4f97-bb29-fb334cd11ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:30.535364 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac9c6-0972-4f97-bb29-fb334cd11ac4 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:30.535917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac9c6-0972-4f97-bb29-fb334cd11ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:30.536408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bac9c6-0972-4f97-bb29-fb334cd11ac4 None admin] PATH_INFO: `/v3/projects/1a86de01022c4cb490a16df9dbe16261` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:30.537988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bac9c6-0972-4f97-bb29-fb334cd11ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=1a86de01022c4cb490a16df9dbe16261)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:30.539842 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bac9c6-0972-4f97-bb29-fb334cd11ac4 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:30.547410 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 186/376] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:30 2022] GET /identity/v3/projects/1a86de01022c4cb490a16df9dbe16261 => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:30.549507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac9c6-0972-4f97-bb29-fb334cd11ac4 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:30.657023 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:30.678830 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:30.682956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bac9c6-0972-4f97-bb29-fb334cd11ac4 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:30.731244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cc448-eb3a-44e4-bbb0-f7680c2255a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:30.732049 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cc448-eb3a-44e4-bbb0-f7680c2255a6 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:30.732226 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cc448-eb3a-44e4-bbb0-f7680c2255a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:30.732487 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109cc448-eb3a-44e4-bbb0-f7680c2255a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:30.733394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cc448-eb3a-44e4-bbb0-f7680c2255a6 None admin] RBAC: Adding query filter params (group.id=d1dc1543fa3a4976b0b58bbacd9abd88, role.id=85d95bf96f68469397338d49ad9fd8fa, scope.project.id=36e5f01822474e888f237e6000a33a94) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:30.733724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cc448-eb3a-44e4-bbb0-f7680c2255a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:30.735330 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109cc448-eb3a-44e4-bbb0-f7680c2255a6 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:30.749630 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 187/377] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:30 2022] GET /identity/v3/role_assignments?group.id=d1dc1543fa3a4976b0b58bbacd9abd88&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=85d95bf96f68469397338d49ad9fd8fa => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:30.752702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cc448-eb3a-44e4-bbb0-f7680c2255a6 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:30.794993 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b61f257-e3db-498e-8da7-6ffdca3e0469 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:30.879242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab6e22-71a3-43ea-ab90-c283e05fa4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:30.879936 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab6e22-71a3-43ea-ab90-c283e05fa4f6 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:30.880215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab6e22-71a3-43ea-ab90-c283e05fa4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:30.880494 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab6e22-71a3-43ea-ab90-c283e05fa4f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:30.881328 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab6e22-71a3-43ea-ab90-c283e05fa4f6 None admin] RBAC: Adding query filter params (group.id=d1dc1543fa3a4976b0b58bbacd9abd88, role.id=209cb6e49795432bb796352cec30474f, scope.project.id=36e5f01822474e888f237e6000a33a94) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:30.881643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab6e22-71a3-43ea-ab90-c283e05fa4f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:30.883163 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab6e22-71a3-43ea-ab90-c283e05fa4f6 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:30.889664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 191/378] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:30 2022] GET /identity/v3/role_assignments?group.id=d1dc1543fa3a4976b0b58bbacd9abd88&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=209cb6e49795432bb796352cec30474f => generated 260 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:30.922821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109cc448-eb3a-44e4-bbb0-f7680c2255a6 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:30.961552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1fe10-8326-4e7a-8c1b-1d13f9fb502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:30.962457 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1fe10-8326-4e7a-8c1b-1d13f9fb502b None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:30.962744 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1fe10-8326-4e7a-8c1b-1d13f9fb502b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:30.963023 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1fe10-8326-4e7a-8c1b-1d13f9fb502b None admin] PATH_INFO: `/v3/groups/f927a1d5cf234547a7254797bbd97160` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:30.970832 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1fe10-8326-4e7a-8c1b-1d13f9fb502b None admin] RBAC: Authorizing `identity:get_group(group_id=f927a1d5cf234547a7254797bbd97160)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:30.972408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1fe10-8326-4e7a-8c1b-1d13f9fb502b None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:30.974640 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 188/379] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:30 2022] GET /identity/v3/groups/f927a1d5cf234547a7254797bbd97160 => generated 229 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:30.980782 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab6e22-71a3-43ea-ab90-c283e05fa4f6 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:31.116194 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab6e22-71a3-43ea-ab90-c283e05fa4f6 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:31.126702 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:31.158320 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b4f03-64fd-4f99-95a9-8b8684782ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:31.159027 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b4f03-64fd-4f99-95a9-8b8684782ee1 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.159312 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b4f03-64fd-4f99-95a9-8b8684782ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.159593 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b4f03-64fd-4f99-95a9-8b8684782ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.160436 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b4f03-64fd-4f99-95a9-8b8684782ee1 None admin] RBAC: Adding query filter params (group.id=f927a1d5cf234547a7254797bbd97160, role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=1a86de01022c4cb490a16df9dbe16261) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:31.160751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b4f03-64fd-4f99-95a9-8b8684782ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:31.162228 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b4f03-64fd-4f99-95a9-8b8684782ee1 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:31.168738 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 192/380] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:30 2022] GET /identity/v3/role_assignments?group.id=f927a1d5cf234547a7254797bbd97160&scope.project.id=1a86de01022c4cb490a16df9dbe16261&role.id=8e22816a513845d88f4934c2164a142b => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:31.937303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e397-954c-4e2c-8aee-5afd9f0038dc None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.938162 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e397-954c-4e2c-8aee-5afd9f0038dc None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.938629 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10e397-954c-4e2c-8aee-5afd9f0038dc None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.940219 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 189/381] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:31.946393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e8e8c-b42d-4075-af0d-6a4ffe9958c5 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:31.947321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e8e8c-b42d-4075-af0d-6a4ffe9958c5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:31.947819 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e8e8c-b42d-4075-af0d-6a4ffe9958c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:31.967730 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-c58e8e8c-b42d-4075-af0d-6a4ffe9958c5 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:31.969640 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-c58e8e8c-b42d-4075-af0d-6a4ffe9958c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:32.048399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 193/382] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:32.075356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e397-954c-4e2c-8aee-5afd9f0038dc None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.114217 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.198959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10e397-954c-4e2c-8aee-5afd9f0038dc None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.240333 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed8b20-0081-4d99-9246-7619a7c270e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.241137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed8b20-0081-4d99-9246-7619a7c270e2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.241426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed8b20-0081-4d99-9246-7619a7c270e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.241705 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed8b20-0081-4d99-9246-7619a7c270e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.256891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed8b20-0081-4d99-9246-7619a7c270e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-3fed8b20-0081-4d99-9246-7619a7c270e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:32.264889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:32.265949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:32.266747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 190/383] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:32.273779 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e8e8c-b42d-4075-af0d-6a4ffe9958c5 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.377292 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e8e8c-b42d-4075-af0d-6a4ffe9958c5 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.378917 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.413661 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623a30-8b65-48ff-9379-1e6e0e8a6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.414395 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623a30-8b65-48ff-9379-1e6e0e8a6355 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.414713 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623a30-8b65-48ff-9379-1e6e0e8a6355 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.415026 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623a30-8b65-48ff-9379-1e6e0e8a6355 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.415781 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40623a30-8b65-48ff-9379-1e6e0e8a6355 None admin] RBAC: Adding query filter params (name=member) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:32.416092 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40623a30-8b65-48ff-9379-1e6e0e8a6355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.417546 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40623a30-8b65-48ff-9379-1e6e0e8a6355 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.426868 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 194/384] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:32.435724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed8b20-0081-4d99-9246-7619a7c270e2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.546288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:32.566086 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed8b20-0081-4d99-9246-7619a7c270e2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.614189 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18001cc-85e1-460e-b397-39b8d05ad283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.615146 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18001cc-85e1-460e-b397-39b8d05ad283 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.615429 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18001cc-85e1-460e-b397-39b8d05ad283 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.615703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18001cc-85e1-460e-b397-39b8d05ad283 None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.617046 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18001cc-85e1-460e-b397-39b8d05ad283 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.618579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18001cc-85e1-460e-b397-39b8d05ad283 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.620229 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 191/385] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:32.625899 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623a30-8b65-48ff-9379-1e6e0e8a6355 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.727972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623a30-8b65-48ff-9379-1e6e0e8a6355 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.762844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbf4cb-6032-48e7-9540-98c3382dde2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:32.763712 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbf4cb-6032-48e7-9540-98c3382dde2d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.763993 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbf4cb-6032-48e7-9540-98c3382dde2d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.764269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbf4cb-6032-48e7-9540-98c3382dde2d None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.765918 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbf4cb-6032-48e7-9540-98c3382dde2d None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:32.767604 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbf4cb-6032-48e7-9540-98c3382dde2d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:32.769602 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 195/386] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:32 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:32.775172 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18001cc-85e1-460e-b397-39b8d05ad283 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:32.926747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144383-bbfd-4f42-b79e-618b7bd8dc95 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.926956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144383-bbfd-4f42-b79e-618b7bd8dc95 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.927241 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9144383-bbfd-4f42-b79e-618b7bd8dc95 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.928745 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 196/387] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:32.937419 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7d256-44cd-4b04-8160-fd29e79777d0 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:32.937716 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7d256-44cd-4b04-8160-fd29e79777d0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:32.938767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7d256-44cd-4b04-8160-fd29e79777d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:32.946880 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18001cc-85e1-460e-b397-39b8d05ad283 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:32.969956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-75c7d256-44cd-4b04-8160-fd29e79777d0 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:32.971190 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-75c7d256-44cd-4b04-8160-fd29e79777d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:33.012656 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aee6ee-a4b9-456b-ab4e-232d49f51fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:33.013547 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aee6ee-a4b9-456b-ab4e-232d49f51fed None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.013835 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aee6ee-a4b9-456b-ab4e-232d49f51fed None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.014115 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aee6ee-a4b9-456b-ab4e-232d49f51fed None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a/groups/d1dc1543fa3a4976b0b58bbacd9abd88/roles/209cb6e49795432bb796352cec30474f` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.017991 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aee6ee-a4b9-456b-ab4e-232d49f51fed None admin] RBAC: Authorizing `identity:create_grant(project_id=848b8e76a38e4d9da24492efeec48f1a, group_id=d1dc1543fa3a4976b0b58bbacd9abd88, role_id=209cb6e49795432bb796352cec30474f)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:33.019479 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19aee6ee-a4b9-456b-ab4e-232d49f51fed None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:33.022698 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:33.038557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 192/388] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:32 2022] PUT /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a/groups/d1dc1543fa3a4976b0b58bbacd9abd88/roles/209cb6e49795432bb796352cec30474f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:35:33.111955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 197/389] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:33.155158 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aee6ee-a4b9-456b-ab4e-232d49f51fed None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:33.177858 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:33.269347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aee6ee-a4b9-456b-ab4e-232d49f51fed None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:33.305211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0158187-d571-49ce-953d-3fe16abb1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:33.306035 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0158187-d571-49ce-953d-3fe16abb1851 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.306324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0158187-d571-49ce-953d-3fe16abb1851 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.306639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0158187-d571-49ce-953d-3fe16abb1851 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.318277 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0158187-d571-49ce-953d-3fe16abb1851 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-a0158187-d571-49ce-953d-3fe16abb1851 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:33.326551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:33.327756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:33.328529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:33.329128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 193/390] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:33.336700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7d256-44cd-4b04-8160-fd29e79777d0 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:33.485363 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7d256-44cd-4b04-8160-fd29e79777d0 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:33.536059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04443-e1b4-4407-9b84-ebc8a00803b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:33.536754 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04443-e1b4-4407-9b84-ebc8a00803b6 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.537038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04443-e1b4-4407-9b84-ebc8a00803b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.537323 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c04443-e1b4-4407-9b84-ebc8a00803b6 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.538083 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c04443-e1b4-4407-9b84-ebc8a00803b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:33.538400 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c04443-e1b4-4407-9b84-ebc8a00803b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:33.539859 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c04443-e1b4-4407-9b84-ebc8a00803b6 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:33.553760 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 198/391] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:33.555464 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0158187-d571-49ce-953d-3fe16abb1851 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:33.644849 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:33.669548 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0158187-d571-49ce-953d-3fe16abb1851 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:33.706996 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29937b-8cbc-4306-8501-af196d2fc4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:33.707877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29937b-8cbc-4306-8501-af196d2fc4e2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.708166 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29937b-8cbc-4306-8501-af196d2fc4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.708446 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29937b-8cbc-4306-8501-af196d2fc4e2 None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.709641 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29937b-8cbc-4306-8501-af196d2fc4e2 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:33.711140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29937b-8cbc-4306-8501-af196d2fc4e2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:33.717283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 194/392] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:33 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:33.719644 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04443-e1b4-4407-9b84-ebc8a00803b6 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:33.747274 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:33.817729 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14731027-db42-4ab5-ae2d-429e1eebc0e5 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.818039 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14731027-db42-4ab5-ae2d-429e1eebc0e5 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.818370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14731027-db42-4ab5-ae2d-429e1eebc0e5 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.820010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 195/393] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:33.825600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90004-d178-4284-9f6a-047a33468977 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.826185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90004-d178-4284-9f6a-047a33468977 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.826702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90004-d178-4284-9f6a-047a33468977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.838460 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c04443-e1b4-4407-9b84-ebc8a00803b6 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:33.873342 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78767314-3375-4055-b78b-f88aa9e64d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:33.874740 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-63e90004-d178-4284-9f6a-047a33468977 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:33.875265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78767314-3375-4055-b78b-f88aa9e64d0c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:33.875698 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78767314-3375-4055-b78b-f88aa9e64d0c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:33.876059 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-63e90004-d178-4284-9f6a-047a33468977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:33.876314 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78767314-3375-4055-b78b-f88aa9e64d0c None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:33.877703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78767314-3375-4055-b78b-f88aa9e64d0c None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:33.879353 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78767314-3375-4055-b78b-f88aa9e64d0c None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:33.886151 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 199/394] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:33 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:33.888600 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78767314-3375-4055-b78b-f88aa9e64d0c None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:33.996726 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:34.007074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78767314-3375-4055-b78b-f88aa9e64d0c None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:34.049153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9a154-47bd-409c-bfb1-372e2147cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:34.050824 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9a154-47bd-409c-bfb1-372e2147cad6 None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.051321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9a154-47bd-409c-bfb1-372e2147cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.052024 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9a154-47bd-409c-bfb1-372e2147cad6 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a/groups/d1dc1543fa3a4976b0b58bbacd9abd88/roles/85d95bf96f68469397338d49ad9fd8fa` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.054648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9a154-47bd-409c-bfb1-372e2147cad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=848b8e76a38e4d9da24492efeec48f1a, group_id=d1dc1543fa3a4976b0b58bbacd9abd88, role_id=85d95bf96f68469397338d49ad9fd8fa)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:34.056662 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f9a154-47bd-409c-bfb1-372e2147cad6 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:34.064546 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 196/395] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:34.089236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 200/396] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:33 2022] PUT /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a/groups/d1dc1543fa3a4976b0b58bbacd9abd88/roles/85d95bf96f68469397338d49ad9fd8fa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:34.116778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e90004-d178-4284-9f6a-047a33468977 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:34.235586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:34.266232 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e90004-d178-4284-9f6a-047a33468977 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:34.313256 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f1583-8653-4b2c-947f-fe95773afe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:34.314546 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f1583-8653-4b2c-947f-fe95773afe58 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.315027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f1583-8653-4b2c-947f-fe95773afe58 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.315490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f1583-8653-4b2c-947f-fe95773afe58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.336258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f1583-8653-4b2c-947f-fe95773afe58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-186f1583-8653-4b2c-947f-fe95773afe58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:34.344973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:34.345864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:34.346875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 197/397] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:34.354590 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9a154-47bd-409c-bfb1-372e2147cad6 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:34.368621 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2824-c7d3-4fe9-abb2-db76a114a9f0 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.368807 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2824-c7d3-4fe9-abb2-db76a114a9f0 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.369046 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f2824-c7d3-4fe9-abb2-db76a114a9f0 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.370740 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 198/398] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:34.375895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b71e3-3ecf-4bd7-beca-5dfdbc29ee20 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.376182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b71e3-3ecf-4bd7-beca-5dfdbc29ee20 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.376701 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b71e3-3ecf-4bd7-beca-5dfdbc29ee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.400575 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-975b71e3-3ecf-4bd7-beca-5dfdbc29ee20 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:34.401900 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-975b71e3-3ecf-4bd7-beca-5dfdbc29ee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:34.496432 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f9a154-47bd-409c-bfb1-372e2147cad6 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:34.504555 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 199/399] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:34.506317 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42842-861a-4c0b-b4ca-d6e9423629a1 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.506949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42842-861a-4c0b-b4ca-d6e9423629a1 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.507423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c42842-861a-4c0b-b4ca-d6e9423629a1 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.512973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 200/400] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:34.515722 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddeaf0-1e82-45d6-96ca-3e31a22aafbb None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.516228 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddeaf0-1e82-45d6-96ca-3e31a22aafbb None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.516758 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddeaf0-1e82-45d6-96ca-3e31a22aafbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.549264 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-4cddeaf0-1e82-45d6-96ca-3e31a22aafbb None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:34.550834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-4cddeaf0-1e82-45d6-96ca-3e31a22aafbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:34.556859 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa7b82-3ed1-4988-b159-9dfe3b4dd9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:34.557880 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa7b82-3ed1-4988-b159-9dfe3b4dd9d5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.558443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa7b82-3ed1-4988-b159-9dfe3b4dd9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.558932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa7b82-3ed1-4988-b159-9dfe3b4dd9d5 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.559927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa7b82-3ed1-4988-b159-9dfe3b4dd9d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:34.560436 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa7b82-3ed1-4988-b159-9dfe3b4dd9d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:34.562821 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa7b82-3ed1-4988-b159-9dfe3b4dd9d5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:34.576578 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 201/401] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:34.578609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa7b82-3ed1-4988-b159-9dfe3b4dd9d5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:34.598873 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:34.636026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:34.646400 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 201/402] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:34.647582 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddeaf0-1e82-45d6-96ca-3e31a22aafbb None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:34.705672 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa7b82-3ed1-4988-b159-9dfe3b4dd9d5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:34.746392 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278b34-818b-4c09-a25a-fcd33834d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:34.747593 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278b34-818b-4c09-a25a-fcd33834d8bd None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.748080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278b34-818b-4c09-a25a-fcd33834d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.748843 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4278b34-818b-4c09-a25a-fcd33834d8bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.761400 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4278b34-818b-4c09-a25a-fcd33834d8bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e4278b34-818b-4c09-a25a-fcd33834d8bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:34.769411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:34.770268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:34.771620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:34.775652 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 202/403] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:34.776406 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278b34-818b-4c09-a25a-fcd33834d8bd None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:34.792427 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddeaf0-1e82-45d6-96ca-3e31a22aafbb None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:34.829584 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4509-00ab-491e-b7d9-770445644a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:34.830866 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4509-00ab-491e-b7d9-770445644a30 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.831343 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4509-00ab-491e-b7d9-770445644a30 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.831793 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4509-00ab-491e-b7d9-770445644a30 None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.833185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d4509-00ab-491e-b7d9-770445644a30 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:34.834865 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d4509-00ab-491e-b7d9-770445644a30 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:34.836754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 202/404] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:34 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:34.842206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4509-00ab-491e-b7d9-770445644a30 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:34.868905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:34.904738 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4278b34-818b-4c09-a25a-fcd33834d8bd None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:34.911423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:34.951006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a66034-8e0d-4e5e-b4ef-d05bb92b02f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:34.952616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66034-8e0d-4e5e-b4ef-d05bb92b02f5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:34.952616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66034-8e0d-4e5e-b4ef-d05bb92b02f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:34.952895 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66034-8e0d-4e5e-b4ef-d05bb92b02f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:34.962859 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4509-00ab-491e-b7d9-770445644a30 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:34.967381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a66034-8e0d-4e5e-b4ef-d05bb92b02f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-a2a66034-8e0d-4e5e-b4ef-d05bb92b02f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:34.977265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:34.978204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:34.979038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:34.983901 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 203/405] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:34.984827 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a66034-8e0d-4e5e-b4ef-d05bb92b02f5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.007301 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f0d51-fe13-42b8-afe8-5c24cb6c63c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.008329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f0d51-fe13-42b8-afe8-5c24cb6c63c2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.008851 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f0d51-fe13-42b8-afe8-5c24cb6c63c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.009399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f0d51-fe13-42b8-afe8-5c24cb6c63c2 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.010359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f0d51-fe13-42b8-afe8-5c24cb6c63c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:35.010905 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f0d51-fe13-42b8-afe8-5c24cb6c63c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.012549 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f0d51-fe13-42b8-afe8-5c24cb6c63c2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.022769 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 203/406] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.023997 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f0d51-fe13-42b8-afe8-5c24cb6c63c2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.115527 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a66034-8e0d-4e5e-b4ef-d05bb92b02f5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.153420 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3d2c-2bd7-41aa-8eca-7365cfdb5ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.154236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3d2c-2bd7-41aa-8eca-7365cfdb5ba1 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.154550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3d2c-2bd7-41aa-8eca-7365cfdb5ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.154832 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3d2c-2bd7-41aa-8eca-7365cfdb5ba1 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.156099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3d2c-2bd7-41aa-8eca-7365cfdb5ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.157711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3d2c-2bd7-41aa-8eca-7365cfdb5ba1 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.164027 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 204/407] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:34 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.164027 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3d2c-2bd7-41aa-8eca-7365cfdb5ba1 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.164027 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.165786 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f0d51-fe13-42b8-afe8-5c24cb6c63c2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.194610 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.208627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882ea04-6e51-4e9c-8962-90a5c616822f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.209691 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882ea04-6e51-4e9c-8962-90a5c616822f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.210177 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882ea04-6e51-4e9c-8962-90a5c616822f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.210725 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882ea04-6e51-4e9c-8962-90a5c616822f None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.211688 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882ea04-6e51-4e9c-8962-90a5c616822f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:35.212193 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882ea04-6e51-4e9c-8962-90a5c616822f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.213793 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c882ea04-6e51-4e9c-8962-90a5c616822f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.228648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 204/408] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.229837 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882ea04-6e51-4e9c-8962-90a5c616822f None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.267006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3d2c-2bd7-41aa-8eca-7365cfdb5ba1 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.302610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e935-f212-409f-9c13-986c4993c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.303402 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e935-f212-409f-9c13-986c4993c569 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.303685 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e935-f212-409f-9c13-986c4993c569 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.303958 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69e935-f212-409f-9c13-986c4993c569 None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.305133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69e935-f212-409f-9c13-986c4993c569 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.306630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce69e935-f212-409f-9c13-986c4993c569 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.308269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 205/409] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:35 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.309710 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e935-f212-409f-9c13-986c4993c569 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.343952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c882ea04-6e51-4e9c-8962-90a5c616822f None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.381215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0037f-fa82-44a3-86c1-1dc461daa4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.382475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0037f-fa82-44a3-86c1-1dc461daa4e1 None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.382968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0037f-fa82-44a3-86c1-1dc461daa4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.383441 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0037f-fa82-44a3-86c1-1dc461daa4e1 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94/groups/d1dc1543fa3a4976b0b58bbacd9abd88/roles/85d95bf96f68469397338d49ad9fd8fa` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.386076 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0037f-fa82-44a3-86c1-1dc461daa4e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=36e5f01822474e888f237e6000a33a94, group_id=d1dc1543fa3a4976b0b58bbacd9abd88, role_id=85d95bf96f68469397338d49ad9fd8fa)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.386825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.388206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0037f-fa82-44a3-86c1-1dc461daa4e1 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.409611 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 205/410] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:35 2022] PUT /identity/v3/projects/36e5f01822474e888f237e6000a33a94/groups/d1dc1543fa3a4976b0b58bbacd9abd88/roles/85d95bf96f68469397338d49ad9fd8fa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:35.418656 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0037f-fa82-44a3-86c1-1dc461daa4e1 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.442700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce69e935-f212-409f-9c13-986c4993c569 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.479659 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.540001 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b7d9-196d-41f6-912d-1d43aa37dac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.541261 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b7d9-196d-41f6-912d-1d43aa37dac9 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.541750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b7d9-196d-41f6-912d-1d43aa37dac9 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.542253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b7d9-196d-41f6-912d-1d43aa37dac9 None admin] PATH_INFO: `/v3/groups/f927a1d5cf234547a7254797bbd97160` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.547597 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672b7d9-196d-41f6-912d-1d43aa37dac9 None admin] RBAC: Authorizing `identity:get_group(group_id=f927a1d5cf234547a7254797bbd97160)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.549432 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672b7d9-196d-41f6-912d-1d43aa37dac9 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.550814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0037f-fa82-44a3-86c1-1dc461daa4e1 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.553370 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 206/411] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:35 2022] GET /identity/v3/groups/f927a1d5cf234547a7254797bbd97160 => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.563545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b7d9-196d-41f6-912d-1d43aa37dac9 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.591787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2762ff3-817b-4c58-8fb1-9d54646260bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.593150 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762ff3-817b-4c58-8fb1-9d54646260bb None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.593389 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762ff3-817b-4c58-8fb1-9d54646260bb None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.593891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2762ff3-817b-4c58-8fb1-9d54646260bb None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.595208 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2762ff3-817b-4c58-8fb1-9d54646260bb None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.597155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2762ff3-817b-4c58-8fb1-9d54646260bb None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.600337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 206/412] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:35 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.607105 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2762ff3-817b-4c58-8fb1-9d54646260bb None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.730591 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2762ff3-817b-4c58-8fb1-9d54646260bb None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.747328 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:35.772743 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b04ba6-80e8-4609-b454-28f5573f903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.773920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04ba6-80e8-4609-b454-28f5573f903d None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.774216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04ba6-80e8-4609-b454-28f5573f903d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.774529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b04ba6-80e8-4609-b454-28f5573f903d None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94/groups/d1dc1543fa3a4976b0b58bbacd9abd88/roles/209cb6e49795432bb796352cec30474f` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.776497 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b04ba6-80e8-4609-b454-28f5573f903d None admin] RBAC: Authorizing `identity:create_grant(project_id=36e5f01822474e888f237e6000a33a94, group_id=d1dc1543fa3a4976b0b58bbacd9abd88, role_id=209cb6e49795432bb796352cec30474f)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.777470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672b7d9-196d-41f6-912d-1d43aa37dac9 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:35.777986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b04ba6-80e8-4609-b454-28f5573f903d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.794276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 207/413] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:35 2022] PUT /identity/v3/projects/36e5f01822474e888f237e6000a33a94/groups/d1dc1543fa3a4976b0b58bbacd9abd88/roles/209cb6e49795432bb796352cec30474f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:35.795822 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2cb2-21b6-455a-a9c9-8145e7e31f7b None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.796751 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2cb2-21b6-455a-a9c9-8145e7e31f7b None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.797043 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a2cb2-21b6-455a-a9c9-8145e7e31f7b None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.802456 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 208/414] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:35.804582 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b7e9f-a2e4-4806-9c3d-34f1272a0d4d None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.805025 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b7e9f-a2e4-4806-9c3d-34f1272a0d4d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.805442 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b7e9f-a2e4-4806-9c3d-34f1272a0d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.833876 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-5a4b7e9f-a2e4-4806-9c3d-34f1272a0d4d None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:35.836481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-5a4b7e9f-a2e4-4806-9c3d-34f1272a0d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:35.853797 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00244f9-c61f-4ec2-9225-232763ce85fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:35.855033 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00244f9-c61f-4ec2-9225-232763ce85fe None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:35.855524 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00244f9-c61f-4ec2-9225-232763ce85fe None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:35.855947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00244f9-c61f-4ec2-9225-232763ce85fe None admin] PATH_INFO: `/v3/projects/1a86de01022c4cb490a16df9dbe16261` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:35.860302 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00244f9-c61f-4ec2-9225-232763ce85fe None admin] RBAC: Authorizing `identity:get_project(project_id=1a86de01022c4cb490a16df9dbe16261)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:35.862051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00244f9-c61f-4ec2-9225-232763ce85fe None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:35.864154 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 207/415] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:35 2022] GET /identity/v3/projects/1a86de01022c4cb490a16df9dbe16261 => generated 344 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:35.872659 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00244f9-c61f-4ec2-9225-232763ce85fe None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:35.895152 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.018806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00244f9-c61f-4ec2-9225-232763ce85fe None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.034401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 209/416] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:36.068531 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ecbab-af15-4598-899f-6820f988da6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.069348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ecbab-af15-4598-899f-6820f988da6d None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.069631 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ecbab-af15-4598-899f-6820f988da6d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.069909 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ecbab-af15-4598-899f-6820f988da6d None admin] PATH_INFO: `/v3/projects/1a86de01022c4cb490a16df9dbe16261/groups/f927a1d5cf234547a7254797bbd97160/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.071902 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b7e9f-a2e4-4806-9c3d-34f1272a0d4d None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.072289 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ecbab-af15-4598-899f-6820f988da6d None admin] RBAC: Authorizing `identity:create_grant(project_id=1a86de01022c4cb490a16df9dbe16261, group_id=f927a1d5cf234547a7254797bbd97160, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:36.073762 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ecbab-af15-4598-899f-6820f988da6d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:36.092027 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 208/417] 10.222.0.26 () {58 vars in 1442 bytes} [Sat Jun 25 20:35:35 2022] PUT /identity/v3/projects/1a86de01022c4cb490a16df9dbe16261/groups/f927a1d5cf234547a7254797bbd97160/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:35:36.215137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b7e9f-a2e4-4806-9c3d-34f1272a0d4d None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.218398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.267862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c4d12-7aeb-43d0-802c-7e5ac06ed61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.268681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c4d12-7aeb-43d0-802c-7e5ac06ed61f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.268961 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c4d12-7aeb-43d0-802c-7e5ac06ed61f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.269232 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c4d12-7aeb-43d0-802c-7e5ac06ed61f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.287970 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c4d12-7aeb-43d0-802c-7e5ac06ed61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-5a7c4d12-7aeb-43d0-802c-7e5ac06ed61f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:36.295984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:36.297055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:36.297828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 210/418] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:36.303094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ecbab-af15-4598-899f-6820f988da6d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.372031 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.410016 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ecbab-af15-4598-899f-6820f988da6d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.444906 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5a8bf-cd68-4ca7-9774-2eec5aa2bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.445586 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5a8bf-cd68-4ca7-9774-2eec5aa2bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.445868 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5a8bf-cd68-4ca7-9774-2eec5aa2bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.446144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5a8bf-cd68-4ca7-9774-2eec5aa2bcf0 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.446973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5a8bf-cd68-4ca7-9774-2eec5aa2bcf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:36.447322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5a8bf-cd68-4ca7-9774-2eec5aa2bcf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:36.448741 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5a8bf-cd68-4ca7-9774-2eec5aa2bcf0 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:36.457938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 209/419] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:36.468069 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c4d12-7aeb-43d0-802c-7e5ac06ed61f None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.593724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c4d12-7aeb-43d0-802c-7e5ac06ed61f None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:36.631467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ee84c-a5a5-44b4-b4ac-89198b0f5036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:36.632132 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee84c-a5a5-44b4-b4ac-89198b0f5036 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.632417 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee84c-a5a5-44b4-b4ac-89198b0f5036 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.632764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee84c-a5a5-44b4-b4ac-89198b0f5036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.665522 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:36.721773 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ee84c-a5a5-44b4-b4ac-89198b0f5036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:36.723702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ee84c-a5a5-44b4-b4ac-89198b0f5036 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:36.786629 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e38b7c-4b4b-49c0-a1cb-4a70ab7b6e06 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.786852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e38b7c-4b4b-49c0-a1cb-4a70ab7b6e06 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.787100 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e38b7c-4b4b-49c0-a1cb-4a70ab7b6e06 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.788728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 210/420] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:36.793575 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227488c6-5ef2-424b-bf99-197e708130ac None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:36.793860 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227488c6-5ef2-424b-bf99-197e708130ac None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:36.794138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227488c6-5ef2-424b-bf99-197e708130ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:36.821046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-227488c6-5ef2-424b-bf99-197e708130ac None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:36.822238 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-227488c6-5ef2-424b-bf99-197e708130ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:36.884380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 211/421] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:36.892323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ee84c-a5a5-44b4-b4ac-89198b0f5036 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:36.955437 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 211/422] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:37.007346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.020883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227488c6-5ef2-424b-bf99-197e708130ac None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.053090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ee84c-a5a5-44b4-b4ac-89198b0f5036 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.110742 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.115520 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d7403-50c0-421c-ab90-1a1dca31f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.116457 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7403-50c0-421c-ab90-1a1dca31f903 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.116736 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7403-50c0-421c-ab90-1a1dca31f903 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.117007 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d7403-50c0-421c-ab90-1a1dca31f903 None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.119019 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d7403-50c0-421c-ab90-1a1dca31f903 None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.121099 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d7403-50c0-421c-ab90-1a1dca31f903 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.123768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 212/423] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:36 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:37.132871 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d7403-50c0-421c-ab90-1a1dca31f903 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.194818 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227488c6-5ef2-424b-bf99-197e708130ac None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.259719 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a9b54-9460-47e3-b14c-6a0fd40b8dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.260563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a9b54-9460-47e3-b14c-6a0fd40b8dcb None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.260849 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a9b54-9460-47e3-b14c-6a0fd40b8dcb None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.261129 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a9b54-9460-47e3-b14c-6a0fd40b8dcb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.281433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d7403-50c0-421c-ab90-1a1dca31f903 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.284356 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a9b54-9460-47e3-b14c-6a0fd40b8dcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-b15a9b54-9460-47e3-b14c-6a0fd40b8dcb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:37.302397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:37.303844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:37.304636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 212/424] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:37.310701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a9b54-9460-47e3-b14c-6a0fd40b8dcb None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.316776 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.322198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a13f8d-498e-459e-963d-c9109b6d14cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.323100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a13f8d-498e-459e-963d-c9109b6d14cc None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.323382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a13f8d-498e-459e-963d-c9109b6d14cc None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.323659 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a13f8d-498e-459e-963d-c9109b6d14cc None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.324845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a13f8d-498e-459e-963d-c9109b6d14cc None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.326303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a13f8d-498e-459e-963d-c9109b6d14cc None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.328383 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 213/425] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:37.333964 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a13f8d-498e-459e-963d-c9109b6d14cc None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.455928 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a9b54-9460-47e3-b14c-6a0fd40b8dcb None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.463220 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a13f8d-498e-459e-963d-c9109b6d14cc None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.474534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.494122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b3f5a-cb5f-43e5-a6d3-4a79dd0c6dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.496082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3f5a-cb5f-43e5-a6d3-4a79dd0c6dd7 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.496082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3f5a-cb5f-43e5-a6d3-4a79dd0c6dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.496082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3f5a-cb5f-43e5-a6d3-4a79dd0c6dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.500122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b3f5a-cb5f-43e5-a6d3-4a79dd0c6dd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:37.500122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b3f5a-cb5f-43e5-a6d3-4a79dd0c6dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.500122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b3f5a-cb5f-43e5-a6d3-4a79dd0c6dd7 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.506913 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 213/426] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:37.512616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b3f5a-cb5f-43e5-a6d3-4a79dd0c6dd7 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.530502 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b60f37-27c0-4cad-b258-f6929a7bbfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.531546 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b60f37-27c0-4cad-b258-f6929a7bbfae None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.532029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b60f37-27c0-4cad-b258-f6929a7bbfae None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.532500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b60f37-27c0-4cad-b258-f6929a7bbfae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.533526 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b60f37-27c0-4cad-b258-f6929a7bbfae None admin] RBAC: Adding query filter params (group.id=d1dc1543fa3a4976b0b58bbacd9abd88, role.id=209cb6e49795432bb796352cec30474f, scope.project.id=848b8e76a38e4d9da24492efeec48f1a) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:37.534061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b60f37-27c0-4cad-b258-f6929a7bbfae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.542438 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b60f37-27c0-4cad-b258-f6929a7bbfae None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.553778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 214/427] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/role_assignments?group.id=d1dc1543fa3a4976b0b58bbacd9abd88&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=209cb6e49795432bb796352cec30474f => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:37.626462 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b3f5a-cb5f-43e5-a6d3-4a79dd0c6dd7 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:37.663900 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dcd0e-4769-4d8c-b6f8-9c91b7c15b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:37.664585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dcd0e-4769-4d8c-b6f8-9c91b7c15b1c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:37.664865 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dcd0e-4769-4d8c-b6f8-9c91b7c15b1c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:37.665145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dcd0e-4769-4d8c-b6f8-9c91b7c15b1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:37.722647 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.746182 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dcd0e-4769-4d8c-b6f8-9c91b7c15b1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:37.747759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dcd0e-4769-4d8c-b6f8-9c91b7c15b1c None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:37.866071 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 214/428] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:37.867592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b60f37-27c0-4cad-b258-f6929a7bbfae None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:37.941470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:37.981434 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b60f37-27c0-4cad-b258-f6929a7bbfae None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.022859 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b972b-ddc0-41c0-b821-b6fa279b1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.023730 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b972b-ddc0-41c0-b821-b6fa279b1d7e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.024009 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b972b-ddc0-41c0-b821-b6fa279b1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.024284 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b972b-ddc0-41c0-b821-b6fa279b1d7e None admin] PATH_INFO: `/v3/projects/848b8e76a38e4d9da24492efeec48f1a` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.025479 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b972b-ddc0-41c0-b821-b6fa279b1d7e None admin] RBAC: Authorizing `identity:get_project(project_id=848b8e76a38e4d9da24492efeec48f1a)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:38.026982 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36b972b-ddc0-41c0-b821-b6fa279b1d7e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:38.028994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 215/429] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:37 2022] GET /identity/v3/projects/848b8e76a38e4d9da24492efeec48f1a => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:38.035266 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dcd0e-4769-4d8c-b6f8-9c91b7c15b1c None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.142831 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:38.165645 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dcd0e-4769-4d8c-b6f8-9c91b7c15b1c None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.208571 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7030462-33c2-4cca-a840-5a84df32f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.209723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030462-33c2-4cca-a840-5a84df32f121 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.210151 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030462-33c2-4cca-a840-5a84df32f121 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.210600 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7030462-33c2-4cca-a840-5a84df32f121 None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.214327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7030462-33c2-4cca-a840-5a84df32f121 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:38.216059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7030462-33c2-4cca-a840-5a84df32f121 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:38.224104 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 215/430] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:38.225802 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b972b-ddc0-41c0-b821-b6fa279b1d7e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.266352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad096d-16ca-482e-9e03-d9de0d1957a4 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.266663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad096d-16ca-482e-9e03-d9de0d1957a4 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.266950 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad096d-16ca-482e-9e03-d9de0d1957a4 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.268478 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 216/431] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:38.273561 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ecb58-bd8f-4421-852f-34babfd1a59b None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.273852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ecb58-bd8f-4421-852f-34babfd1a59b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.274258 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ecb58-bd8f-4421-852f-34babfd1a59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.293680 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-3c1ecb58-bd8f-4421-852f-34babfd1a59b None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:38.294901 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-3c1ecb58-bd8f-4421-852f-34babfd1a59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:38.377203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b972b-ddc0-41c0-b821-b6fa279b1d7e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.388750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 217/432] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:38.418986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:38.429091 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ecb58-bd8f-4421-852f-34babfd1a59b None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.440899 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ba5ef-d72b-4ec2-9927-465448a9e185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.441575 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ba5ef-d72b-4ec2-9927-465448a9e185 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.442184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ba5ef-d72b-4ec2-9927-465448a9e185 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.442502 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ba5ef-d72b-4ec2-9927-465448a9e185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.443345 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ba5ef-d72b-4ec2-9927-465448a9e185 None admin] RBAC: Adding query filter params (group.id=d1dc1543fa3a4976b0b58bbacd9abd88, role.id=85d95bf96f68469397338d49ad9fd8fa, scope.project.id=848b8e76a38e4d9da24492efeec48f1a) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:38.443656 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ba5ef-d72b-4ec2-9927-465448a9e185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:38.445703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ba5ef-d72b-4ec2-9927-465448a9e185 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:38.461582 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 216/433] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/role_assignments?group.id=d1dc1543fa3a4976b0b58bbacd9abd88&scope.project.id=848b8e76a38e4d9da24492efeec48f1a&role.id=85d95bf96f68469397338d49ad9fd8fa => generated 611 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:38.482331 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213937d0-cb52-4734-b7bf-5fc9fae15199 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.482683 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213937d0-cb52-4734-b7bf-5fc9fae15199 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.482966 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213937d0-cb52-4734-b7bf-5fc9fae15199 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.484727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 217/434] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:38.496941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33b67-5713-48c8-88f8-bdacd611a04a None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.497254 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33b67-5713-48c8-88f8-bdacd611a04a None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.497500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af33b67-5713-48c8-88f8-bdacd611a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.523985 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-8af33b67-5713-48c8-88f8-bdacd611a04a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:38.525534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-8af33b67-5713-48c8-88f8-bdacd611a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:38.548874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:38.585277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ecb58-bd8f-4421-852f-34babfd1a59b None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.636219 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcc3fa-b7fd-4c3a-8c14-af0a3963cbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.637062 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcc3fa-b7fd-4c3a-8c14-af0a3963cbf4 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.637341 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcc3fa-b7fd-4c3a-8c14-af0a3963cbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.637610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcc3fa-b7fd-4c3a-8c14-af0a3963cbf4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.645161 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 218/435] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:38.656654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcc3fa-b7fd-4c3a-8c14-af0a3963cbf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e5dcc3fa-b7fd-4c3a-8c14-af0a3963cbf4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:38.664867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:38.665805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 25 20:35:38.666648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:38.670594 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 218/436] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:38.672568 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af33b67-5713-48c8-88f8-bdacd611a04a None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.678850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcc3fa-b7fd-4c3a-8c14-af0a3963cbf4 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.813553 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af33b67-5713-48c8-88f8-bdacd611a04a None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.815232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcc3fa-b7fd-4c3a-8c14-af0a3963cbf4 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:38.851083 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:38.851478 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc7e7e-a23c-4d5f-a14a-35f672f7bbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.851998 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c545cc-19b1-4efa-8d01-a9f9d6600bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:38.852294 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc7e7e-a23c-4d5f-a14a-35f672f7bbf0 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.852619 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc7e7e-a23c-4d5f-a14a-35f672f7bbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.852772 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c545cc-19b1-4efa-8d01-a9f9d6600bf5 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:38.852896 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dc7e7e-a23c-4d5f-a14a-35f672f7bbf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.853111 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c545cc-19b1-4efa-8d01-a9f9d6600bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:38.853390 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c545cc-19b1-4efa-8d01-a9f9d6600bf5 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:38.854150 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c545cc-19b1-4efa-8d01-a9f9d6600bf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:38.854560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c545cc-19b1-4efa-8d01-a9f9d6600bf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:38.856395 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c545cc-19b1-4efa-8d01-a9f9d6600bf5 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:38.860937 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:38.865025 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dc7e7e-a23c-4d5f-a14a-35f672f7bbf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:38.869571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 219/437] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e3dc7e7e-a23c-4d5f-a14a-35f672f7bbf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:38.874975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:38.875912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 25 20:35:38.876731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:38.877326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c545cc-19b1-4efa-8d01-a9f9d6600bf5 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:38.877938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 219/438] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:38.883113 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc7e7e-a23c-4d5f-a14a-35f672f7bbf0 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.007732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dc7e7e-a23c-4d5f-a14a-35f672f7bbf0 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.014487 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c545cc-19b1-4efa-8d01-a9f9d6600bf5 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.046291 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8a36-3280-405e-bdb7-3a5b5917346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.046992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8a36-3280-405e-bdb7-3a5b5917346f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.047274 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8a36-3280-405e-bdb7-3a5b5917346f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.047550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8a36-3280-405e-bdb7-3a5b5917346f None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.048293 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8a36-3280-405e-bdb7-3a5b5917346f None admin] RBAC: Adding query filter params (name=member) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:39.048599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8a36-3280-405e-bdb7-3a5b5917346f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.050024 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8a36-3280-405e-bdb7-3a5b5917346f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.057005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a59ac1-0aad-43fa-b69e-ada8cf4999c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.057908 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a59ac1-0aad-43fa-b69e-ada8cf4999c1 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.058338 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 220/439] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.058627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a59ac1-0aad-43fa-b69e-ada8cf4999c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.059047 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a59ac1-0aad-43fa-b69e-ada8cf4999c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.064013 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8a36-3280-405e-bdb7-3a5b5917346f None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.125344 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.130599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.140413 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a59ac1-0aad-43fa-b69e-ada8cf4999c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.141865 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a59ac1-0aad-43fa-b69e-ada8cf4999c1 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.175855 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8a36-3280-405e-bdb7-3a5b5917346f None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.211908 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764e51b-a649-4f2d-abff-e21f1721cf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.213067 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764e51b-a649-4f2d-abff-e21f1721cf0e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.213067 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764e51b-a649-4f2d-abff-e21f1721cf0e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.213067 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764e51b-a649-4f2d-abff-e21f1721cf0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.245770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 220/440] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:35:39.251379 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a59ac1-0aad-43fa-b69e-ada8cf4999c1 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.286503 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764e51b-a649-4f2d-abff-e21f1721cf0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.288070 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764e51b-a649-4f2d-abff-e21f1721cf0e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.344075 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.347695 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.356534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a59ac1-0aad-43fa-b69e-ada8cf4999c1 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.390650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9db084-e028-4da4-b5c0-7f9054cefc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.391611 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 221/441] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:35:39.391974 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db084-e028-4da4-b5c0-7f9054cefc35 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.391974 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db084-e028-4da4-b5c0-7f9054cefc35 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.392127 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9db084-e028-4da4-b5c0-7f9054cefc35 None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.392813 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca04a7-41bb-4afe-9f0d-787a85efac0e None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.393097 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca04a7-41bb-4afe-9f0d-787a85efac0e None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.393189 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9db084-e028-4da4-b5c0-7f9054cefc35 None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.393372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca04a7-41bb-4afe-9f0d-787a85efac0e None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.394772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 222/442] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:39.394881 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9db084-e028-4da4-b5c0-7f9054cefc35 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.396415 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 221/443] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.399224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca04a7-41bb-4afe-9f0d-787a85efac0e None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.401927 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a8e9-324f-4c78-939e-3f1017456c80 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.402214 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a8e9-324f-4c78-939e-3f1017456c80 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.402521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0a8e9-324f-4c78-939e-3f1017456c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.418408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-c2e0a8e9-324f-4c78-939e-3f1017456c80 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:39.419640 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-c2e0a8e9-324f-4c78-939e-3f1017456c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:39.484623 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 222/444] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:39.485250 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a8e9-324f-4c78-939e-3f1017456c80 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.510047 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca04a7-41bb-4afe-9f0d-787a85efac0e None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.545194 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be615348-5f06-44db-b9c8-194e92360e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.546392 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be615348-5f06-44db-b9c8-194e92360e8d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.546821 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be615348-5f06-44db-b9c8-194e92360e8d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.547105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be615348-5f06-44db-b9c8-194e92360e8d None admin] PATH_INFO: `/v3/projects/36e5f01822474e888f237e6000a33a94` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.548332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be615348-5f06-44db-b9c8-194e92360e8d None admin] RBAC: Authorizing `identity:get_project(project_id=36e5f01822474e888f237e6000a33a94)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.549809 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be615348-5f06-44db-b9c8-194e92360e8d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.551531 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 223/445] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/projects/36e5f01822474e888f237e6000a33a94 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.552290 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be615348-5f06-44db-b9c8-194e92360e8d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.573496 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.579814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.589699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0a8e9-324f-4c78-939e-3f1017456c80 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.623103 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebbea1-4461-4077-a0c5-86d62a8b6442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.623974 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebbea1-4461-4077-a0c5-86d62a8b6442 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.624256 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebbea1-4461-4077-a0c5-86d62a8b6442 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.624532 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebbea1-4461-4077-a0c5-86d62a8b6442 None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.625703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebbea1-4461-4077-a0c5-86d62a8b6442 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.627188 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebbea1-4461-4077-a0c5-86d62a8b6442 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.628824 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 223/446] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.629584 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebbea1-4461-4077-a0c5-86d62a8b6442 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.656638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be615348-5f06-44db-b9c8-194e92360e8d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.690459 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42ec42-aa95-4837-9acb-c7e31a41bc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.691273 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42ec42-aa95-4837-9acb-c7e31a41bc47 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.691562 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42ec42-aa95-4837-9acb-c7e31a41bc47 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.691842 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42ec42-aa95-4837-9acb-c7e31a41bc47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.702127 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42ec42-aa95-4837-9acb-c7e31a41bc47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-0d42ec42-aa95-4837-9acb-c7e31a41bc47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:39.709711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:39.710630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:39.711411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 224/447] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:39.712045 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42ec42-aa95-4837-9acb-c7e31a41bc47 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.734396 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebbea1-4461-4077-a0c5-86d62a8b6442 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.767622 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a7c7e-663e-4c00-8ddd-07925b4fc933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.768509 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a7c7e-663e-4c00-8ddd-07925b4fc933 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.768767 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a7c7e-663e-4c00-8ddd-07925b4fc933 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.769036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a7c7e-663e-4c00-8ddd-07925b4fc933 None admin] PATH_INFO: `/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.770208 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a7c7e-663e-4c00-8ddd-07925b4fc933 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc1543fa3a4976b0b58bbacd9abd88)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.771708 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a7c7e-663e-4c00-8ddd-07925b4fc933 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.773330 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 224/448] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/groups/d1dc1543fa3a4976b0b58bbacd9abd88 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.774089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a7c7e-663e-4c00-8ddd-07925b4fc933 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.798359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.806589 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:39.818670 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42ec42-aa95-4837-9acb-c7e31a41bc47 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.852857 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280fc89-a27b-4864-879f-ebb2f4bd2535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.853522 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280fc89-a27b-4864-879f-ebb2f4bd2535 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.853801 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280fc89-a27b-4864-879f-ebb2f4bd2535 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.854075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280fc89-a27b-4864-879f-ebb2f4bd2535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.854935 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280fc89-a27b-4864-879f-ebb2f4bd2535 None admin] RBAC: Adding query filter params (group.id=d1dc1543fa3a4976b0b58bbacd9abd88, role.id=85d95bf96f68469397338d49ad9fd8fa, scope.project.id=36e5f01822474e888f237e6000a33a94) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:39.855243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280fc89-a27b-4864-879f-ebb2f4bd2535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.856690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280fc89-a27b-4864-879f-ebb2f4bd2535 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.862889 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 225/449] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/role_assignments?group.id=d1dc1543fa3a4976b0b58bbacd9abd88&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=85d95bf96f68469397338d49ad9fd8fa => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.863500 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280fc89-a27b-4864-879f-ebb2f4bd2535 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.895508 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a7c7e-663e-4c00-8ddd-07925b4fc933 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:39.942668 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e4df2-b291-42ab-a2fe-2686c71b853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:39.943767 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e4df2-b291-42ab-a2fe-2686c71b853d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:39.943767 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e4df2-b291-42ab-a2fe-2686c71b853d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:39.944024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e4df2-b291-42ab-a2fe-2686c71b853d None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:39.944753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e4df2-b291-42ab-a2fe-2686c71b853d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:39.945067 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e4df2-b291-42ab-a2fe-2686c71b853d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:39.946546 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e4df2-b291-42ab-a2fe-2686c71b853d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:39.956832 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 225/450] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:39.962562 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e4df2-b291-42ab-a2fe-2686c71b853d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:39.977477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280fc89-a27b-4864-879f-ebb2f4bd2535 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:40.018995 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8173-3a3d-4d96-b02c-0560c96cbb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:40.019992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8173-3a3d-4d96-b02c-0560c96cbb0c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:40.020277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8173-3a3d-4d96-b02c-0560c96cbb0c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:40.020551 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8173-3a3d-4d96-b02c-0560c96cbb0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:40.021386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8173-3a3d-4d96-b02c-0560c96cbb0c None admin] RBAC: Adding query filter params (group.id=d1dc1543fa3a4976b0b58bbacd9abd88, role.id=209cb6e49795432bb796352cec30474f, scope.project.id=36e5f01822474e888f237e6000a33a94) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:40.021701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8173-3a3d-4d96-b02c-0560c96cbb0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:40.023240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8173-3a3d-4d96-b02c-0560c96cbb0c None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:40.030344 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 226/451] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/role_assignments?group.id=d1dc1543fa3a4976b0b58bbacd9abd88&scope.project.id=36e5f01822474e888f237e6000a33a94&role.id=209cb6e49795432bb796352cec30474f => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:40.057590 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:40.078577 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e4df2-b291-42ab-a2fe-2686c71b853d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:40.120197 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31908-c34d-4431-88c2-85aa828720b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:40.120865 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31908-c34d-4431-88c2-85aa828720b8 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:40.121150 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31908-c34d-4431-88c2-85aa828720b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:40.121425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31908-c34d-4431-88c2-85aa828720b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:40.194158 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e31908-c34d-4431-88c2-85aa828720b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:40.195609 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e31908-c34d-4431-88c2-85aa828720b8 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:40.283667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:40.302661 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 226/452] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 25 20:35:40.307949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8173-3a3d-4d96-b02c-0560c96cbb0c None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:40.328503 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:40.413707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8173-3a3d-4d96-b02c-0560c96cbb0c None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:40.447509 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1a472-8cd0-4bc4-9290-5e62da5e29f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:40.448297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1a472-8cd0-4bc4-9290-5e62da5e29f1 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:40.448582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1a472-8cd0-4bc4-9290-5e62da5e29f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:40.448862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b1a472-8cd0-4bc4-9290-5e62da5e29f1 None admin] PATH_INFO: `/v3/projects/1a86de01022c4cb490a16df9dbe16261` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:40.450051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1a472-8cd0-4bc4-9290-5e62da5e29f1 None admin] RBAC: Authorizing `identity:get_project(project_id=1a86de01022c4cb490a16df9dbe16261)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:40.451590 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b1a472-8cd0-4bc4-9290-5e62da5e29f1 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:40.453513 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 227/453] 10.222.0.26 () {56 vars in 1186 bytes} [Sat Jun 25 20:35:40 2022] GET /identity/v3/projects/1a86de01022c4cb490a16df9dbe16261 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:40.459201 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31908-c34d-4431-88c2-85aa828720b8 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:40.565754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31908-c34d-4431-88c2-85aa828720b8 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:40.600304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c88676-22eb-4dd1-8b6f-f481eb0e1754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:40.601158 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c88676-22eb-4dd1-8b6f-f481eb0e1754 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:40.601438 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c88676-22eb-4dd1-8b6f-f481eb0e1754 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:40.601716 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c88676-22eb-4dd1-8b6f-f481eb0e1754 None admin] PATH_INFO: `/v3/groups/f927a1d5cf234547a7254797bbd97160` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:40.602909 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c88676-22eb-4dd1-8b6f-f481eb0e1754 None admin] RBAC: Authorizing `identity:get_group(group_id=f927a1d5cf234547a7254797bbd97160)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:40.604399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c88676-22eb-4dd1-8b6f-f481eb0e1754 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:40.606028 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 227/454] 10.222.0.26 () {56 vars in 1180 bytes} [Sat Jun 25 20:35:40 2022] GET /identity/v3/groups/f927a1d5cf234547a7254797bbd97160 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:40.612715 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1a472-8cd0-4bc4-9290-5e62da5e29f1 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:40.719563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:40.737328 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b1a472-8cd0-4bc4-9290-5e62da5e29f1 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:40.772194 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1431b-5dbd-440a-9fd9-bf2702b68eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:40.772907 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1431b-5dbd-440a-9fd9-bf2702b68eaa None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:40.773224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1431b-5dbd-440a-9fd9-bf2702b68eaa None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:40.773560 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1431b-5dbd-440a-9fd9-bf2702b68eaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:40.774398 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1431b-5dbd-440a-9fd9-bf2702b68eaa None admin] RBAC: Adding query filter params (group.id=f927a1d5cf234547a7254797bbd97160, role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=1a86de01022c4cb490a16df9dbe16261) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:40.774746 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1431b-5dbd-440a-9fd9-bf2702b68eaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:40.776220 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1431b-5dbd-440a-9fd9-bf2702b68eaa None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:40.783526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 228/455] 10.222.0.26 () {56 vars in 1376 bytes} [Sat Jun 25 20:35:40 2022] GET /identity/v3/role_assignments?group.id=f927a1d5cf234547a7254797bbd97160&scope.project.id=1a86de01022c4cb490a16df9dbe16261&role.id=8e22816a513845d88f4934c2164a142b => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:43.350437 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc60f-b68e-4d65-b183-94757bfc6355 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.350981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc60f-b68e-4d65-b183-94757bfc6355 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.350981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297cc60f-b68e-4d65-b183-94757bfc6355 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.352577 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 228/456] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:43.358521 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b29e-cb02-4337-9598-d2842b3d4c32 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.359024 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b29e-cb02-4337-9598-d2842b3d4c32 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.359098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0b29e-cb02-4337-9598-d2842b3d4c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.377138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-64d0b29e-cb02-4337-9598-d2842b3d4c32 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:43.378377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-64d0b29e-cb02-4337-9598-d2842b3d4c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:43.447732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 229/457] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:43.473603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc60f-b68e-4d65-b183-94757bfc6355 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.533593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.540584 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fa37b-5844-466c-93b5-1155f73b1d5c None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.541061 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fa37b-5844-466c-93b5-1155f73b1d5c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.541343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fa37b-5844-466c-93b5-1155f73b1d5c None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.543743 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 230/458] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:43.549638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7880-9ea4-4892-b473-c0d85272c729 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.550253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7880-9ea4-4892-b473-c0d85272c729 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.550593 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb7880-9ea4-4892-b473-c0d85272c729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.568957 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-ebbb7880-9ea4-4892-b473-c0d85272c729 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:43.570338 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-ebbb7880-9ea4-4892-b473-c0d85272c729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:43.599991 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297cc60f-b68e-4d65-b183-94757bfc6355 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.653067 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12373d8-8380-493e-ab62-72612bb17f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.653784 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12373d8-8380-493e-ab62-72612bb17f05 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.654061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12373d8-8380-493e-ab62-72612bb17f05 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.654337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12373d8-8380-493e-ab62-72612bb17f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.663076 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 231/459] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:43.663076 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d9719-c4e0-4368-8324-14dc946e9af3 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.663076 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d9719-c4e0-4368-8324-14dc946e9af3 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.663076 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d9719-c4e0-4368-8324-14dc946e9af3 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.663076 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 232/460] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:43.667082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c54f2-a365-4f55-be88-bfce17016409 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.667694 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c54f2-a365-4f55-be88-bfce17016409 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.667694 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c54f2-a365-4f55-be88-bfce17016409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.669613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12373d8-8380-493e-ab62-72612bb17f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:43.671515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12373d8-8380-493e-ab62-72612bb17f05 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:43.684930 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-4c6c54f2-a365-4f55-be88-bfce17016409 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:43.686277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-4c6c54f2-a365-4f55-be88-bfce17016409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:43.689938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-a12373d8-8380-493e-ab62-72612bb17f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:43.691578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:43.692426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:43.693920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:43.693920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:43.693920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:43.693920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:43.693920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 229/461] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:43.693920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12373d8-8380-493e-ab62-72612bb17f05 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.760561 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 233/462] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:43.761292 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c54f2-a365-4f55-be88-bfce17016409 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.810353 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12373d8-8380-493e-ab62-72612bb17f05 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.814526 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.854790 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ca149-6159-4c42-8353-94171a06362d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.855962 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca149-6159-4c42-8353-94171a06362d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.855962 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca149-6159-4c42-8353-94171a06362d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.856170 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca149-6159-4c42-8353-94171a06362d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.867114 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ca149-6159-4c42-8353-94171a06362d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:43.868116 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c54f2-a365-4f55-be88-bfce17016409 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:43.868598 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ca149-6159-4c42-8353-94171a06362d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-041ca149-6159-4c42-8353-94171a06362d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:43.887887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:43.888792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:43.890984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:43.890984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:43.890984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:43.890984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:43.890984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 230/463] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:43.890984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ca149-6159-4c42-8353-94171a06362d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:43.909805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00647715-12f0-4533-b422-aa12ba7c1da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:43.910403 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00647715-12f0-4533-b422-aa12ba7c1da7 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:43.910718 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00647715-12f0-4533-b422-aa12ba7c1da7 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:43.911111 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00647715-12f0-4533-b422-aa12ba7c1da7 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:43.911849 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00647715-12f0-4533-b422-aa12ba7c1da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:43.912165 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00647715-12f0-4533-b422-aa12ba7c1da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:43.913570 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00647715-12f0-4533-b422-aa12ba7c1da7 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:43.923494 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:43.935804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 234/464] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:43.935804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00647715-12f0-4533-b422-aa12ba7c1da7 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.009425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ca149-6159-4c42-8353-94171a06362d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.050657 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c7577-d352-4a66-a97c-af4e15ccd0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.051452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7577-d352-4a66-a97c-af4e15ccd0a8 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.051734 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7577-d352-4a66-a97c-af4e15ccd0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.052010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7577-d352-4a66-a97c-af4e15ccd0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.056280 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00647715-12f0-4533-b422-aa12ba7c1da7 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.061987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c7577-d352-4a66-a97c-af4e15ccd0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.063494 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c7577-d352-4a66-a97c-af4e15ccd0a8 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-2e9c7577-d352-4a66-a97c-af4e15ccd0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:44.081297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:44.082215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:44.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:44.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:44.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:44.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:44.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 231/465] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:44.083376 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c7577-d352-4a66-a97c-af4e15ccd0a8 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.091055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257120f-93f7-4034-9b39-60c316d173ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.091733 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257120f-93f7-4034-9b39-60c316d173ca None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.092115 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257120f-93f7-4034-9b39-60c316d173ca None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.092430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257120f-93f7-4034-9b39-60c316d173ca None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.093504 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257120f-93f7-4034-9b39-60c316d173ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:44.093817 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257120f-93f7-4034-9b39-60c316d173ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.095261 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257120f-93f7-4034-9b39-60c316d173ca None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.097970 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.107894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 235/466] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:44.109403 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff883a7-6442-42aa-be76-ad376af250c5 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.109698 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff883a7-6442-42aa-be76-ad376af250c5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.109982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff883a7-6442-42aa-be76-ad376af250c5 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.111246 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 236/467] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:44.111940 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff883a7-6442-42aa-be76-ad376af250c5 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.175136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.189001 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c7577-d352-4a66-a97c-af4e15ccd0a8 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.219169 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff883a7-6442-42aa-be76-ad376af250c5 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.224416 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec022e-7b11-4057-adef-7dfba6c1ab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.225085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec022e-7b11-4057-adef-7dfba6c1ab9c None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.225373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec022e-7b11-4057-adef-7dfba6c1ab9c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.225647 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec022e-7b11-4057-adef-7dfba6c1ab9c None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.226353 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec022e-7b11-4057-adef-7dfba6c1ab9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.227847 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec022e-7b11-4057-adef-7dfba6c1ab9c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.258449 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 232/468] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:44 2022] POST /identity/v3/users => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:44.258449 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec022e-7b11-4057-adef-7dfba6c1ab9c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.258728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd923a-ba84-417e-b75e-7bb187efcf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.258728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd923a-ba84-417e-b75e-7bb187efcf60 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.258728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd923a-ba84-417e-b75e-7bb187efcf60 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.258728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd923a-ba84-417e-b75e-7bb187efcf60 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.259053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd923a-ba84-417e-b75e-7bb187efcf60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:44.259053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd923a-ba84-417e-b75e-7bb187efcf60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.259053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd923a-ba84-417e-b75e-7bb187efcf60 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.270390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 237/469] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:44.271750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877d36-d101-42c9-a6c5-d15c7fede2ea None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.272040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877d36-d101-42c9-a6c5-d15c7fede2ea None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.272319 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01877d36-d101-42c9-a6c5-d15c7fede2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.291391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-01877d36-d101-42c9-a6c5-d15c7fede2ea None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:44.292625 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-01877d36-d101-42c9-a6c5-d15c7fede2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:44.347504 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.382462 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 238/470] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:44.382462 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877d36-d101-42c9-a6c5-d15c7fede2ea None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.409505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec022e-7b11-4057-adef-7dfba6c1ab9c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.429923 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.449578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973571c2-981e-4c55-afcd-741faf09a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.450259 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973571c2-981e-4c55-afcd-741faf09a868 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.450578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973571c2-981e-4c55-afcd-741faf09a868 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.450862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973571c2-981e-4c55-afcd-741faf09a868 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.451634 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973571c2-981e-4c55-afcd-741faf09a868 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.453090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973571c2-981e-4c55-afcd-741faf09a868 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.477078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 233/471] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:44 2022] POST /identity/v3/users => generated 248 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:44.477682 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973571c2-981e-4c55-afcd-741faf09a868 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.489627 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01877d36-d101-42c9-a6c5-d15c7fede2ea None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.542944 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094313bc-8a03-40e2-8a2d-7167e8f0ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.544438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094313bc-8a03-40e2-8a2d-7167e8f0ba38 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.544951 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094313bc-8a03-40e2-8a2d-7167e8f0ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.545820 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094313bc-8a03-40e2-8a2d-7167e8f0ba38 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.547625 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094313bc-8a03-40e2-8a2d-7167e8f0ba38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.549722 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094313bc-8a03-40e2-8a2d-7167e8f0ba38 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.587615 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 239/472] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:44 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:35:44.620328 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973571c2-981e-4c55-afcd-741faf09a868 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.645763 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.664398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922e5a1-5e98-475b-abc9-184b7c5fbd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.665600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922e5a1-5e98-475b-abc9-184b7c5fbd03 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.666129 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922e5a1-5e98-475b-abc9-184b7c5fbd03 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.666643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922e5a1-5e98-475b-abc9-184b7c5fbd03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.680305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922e5a1-5e98-475b-abc9-184b7c5fbd03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.682221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922e5a1-5e98-475b-abc9-184b7c5fbd03 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-a922e5a1-5e98-475b-abc9-184b7c5fbd03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:44.701875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:44.702845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:44.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:44.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:44.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:44.703690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:44.706015 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 234/473] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:44.711676 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094313bc-8a03-40e2-8a2d-7167e8f0ba38 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.825942 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094313bc-8a03-40e2-8a2d-7167e8f0ba38 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:44.829508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:44.866802 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9c1b6-6a4e-48db-8148-4c163bfff5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:44.867488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9c1b6-6a4e-48db-8148-4c163bfff5a9 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:44.867772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9c1b6-6a4e-48db-8148-4c163bfff5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:44.868053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9c1b6-6a4e-48db-8148-4c163bfff5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:44.868785 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9c1b6-6a4e-48db-8148-4c163bfff5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:44.869095 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9c1b6-6a4e-48db-8148-4c163bfff5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:44.870519 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd9c1b6-6a4e-48db-8148-4c163bfff5a9 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:44.883110 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 240/474] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:44.888633 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922e5a1-5e98-475b-abc9-184b7c5fbd03 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:44.994437 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922e5a1-5e98-475b-abc9-184b7c5fbd03 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:45.028341 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a39715-ccd9-408a-9cbc-74d0dff92250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:45.029025 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a39715-ccd9-408a-9cbc-74d0dff92250 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:45.029343 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a39715-ccd9-408a-9cbc-74d0dff92250 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:45.029662 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a39715-ccd9-408a-9cbc-74d0dff92250 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:45.030562 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a39715-ccd9-408a-9cbc-74d0dff92250 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:45.032032 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a39715-ccd9-408a-9cbc-74d0dff92250 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:45.055525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 235/475] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:35:44 2022] POST /identity/v3/users => generated 249 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:35:46.662456 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47deba8-4bc5-46f5-8bc1-bc6e1bdfbb8f None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.662992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47deba8-4bc5-46f5-8bc1-bc6e1bdfbb8f None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.662992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47deba8-4bc5-46f5-8bc1-bc6e1bdfbb8f None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.664672 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 241/476] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:46.670176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348530e1-8d07-4afa-b4fd-893755da312f None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.670677 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348530e1-8d07-4afa-b4fd-893755da312f None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.670751 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348530e1-8d07-4afa-b4fd-893755da312f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.687853 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-348530e1-8d07-4afa-b4fd-893755da312f None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:46.689052 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-348530e1-8d07-4afa-b4fd-893755da312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:46.713045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:46.767097 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 236/477] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:46.791145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47deba8-4bc5-46f5-8bc1-bc6e1bdfbb8f None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:46.902592 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47deba8-4bc5-46f5-8bc1-bc6e1bdfbb8f None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:46.938276 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe00a5-b28f-47a7-852f-df3039310b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:46.939112 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe00a5-b28f-47a7-852f-df3039310b85 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.939444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe00a5-b28f-47a7-852f-df3039310b85 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.939725 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe00a5-b28f-47a7-852f-df3039310b85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.950942 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe00a5-b28f-47a7-852f-df3039310b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-82fe00a5-b28f-47a7-852f-df3039310b85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:46.958848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:46.959751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:46.960607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:46.964897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 242/478] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:46.967942 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348530e1-8d07-4afa-b4fd-893755da312f None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:46.973604 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bab89-7421-42f5-a4fd-e3ed6c86483d None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.973885 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bab89-7421-42f5-a4fd-e3ed6c86483d None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.974164 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bab89-7421-42f5-a4fd-e3ed6c86483d None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:46.975793 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 243/479] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:46.983571 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54212d96-8d0e-40eb-906a-08c4a803ebca None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:46.983856 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54212d96-8d0e-40eb-906a-08c4a803ebca None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:46.984134 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54212d96-8d0e-40eb-906a-08c4a803ebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.004383 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-54212d96-8d0e-40eb-906a-08c4a803ebca None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:47.005753 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-54212d96-8d0e-40eb-906a-08c4a803ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:47.041190 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.087781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348530e1-8d07-4afa-b4fd-893755da312f None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.101703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 244/480] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:47.103162 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61721cd-ecd7-4211-8712-91b29a3a64e9 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.103517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61721cd-ecd7-4211-8712-91b29a3a64e9 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.103881 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61721cd-ecd7-4211-8712-91b29a3a64e9 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.105323 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 245/481] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:47.110781 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235cd11-a56f-4852-b90b-1567824165ed None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.111106 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235cd11-a56f-4852-b90b-1567824165ed None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.111353 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235cd11-a56f-4852-b90b-1567824165ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.130245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-c235cd11-a56f-4852-b90b-1567824165ed None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:47.131553 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-c235cd11-a56f-4852-b90b-1567824165ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:47.139602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46580a6f-949c-4187-b642-3c1fd4758106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.140288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46580a6f-949c-4187-b642-3c1fd4758106 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.140569 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46580a6f-949c-4187-b642-3c1fd4758106 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.140843 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46580a6f-949c-4187-b642-3c1fd4758106 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.141591 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46580a6f-949c-4187-b642-3c1fd4758106 None admin] RBAC: Adding query filter params (name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:47.141901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46580a6f-949c-4187-b642-3c1fd4758106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.143333 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46580a6f-949c-4187-b642-3c1fd4758106 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.152033 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 237/482] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:47.152033 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46580a6f-949c-4187-b642-3c1fd4758106 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.181072 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.216381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 246/483] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:47.218483 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235cd11-a56f-4852-b90b-1567824165ed None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.272190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46580a6f-949c-4187-b642-3c1fd4758106 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.309364 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc58849-5e73-4796-b343-9124f6371608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.310165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc58849-5e73-4796-b343-9124f6371608 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.310553 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc58849-5e73-4796-b343-9124f6371608 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.310887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc58849-5e73-4796-b343-9124f6371608 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.311868 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.322162 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc58849-5e73-4796-b343-9124f6371608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-8fc58849-5e73-4796-b343-9124f6371608 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:47.330029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:47.330952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:47.331727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:47.332316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235cd11-a56f-4852-b90b-1567824165ed None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.336087 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 238/484] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:47.336851 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc58849-5e73-4796-b343-9124f6371608 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.369802 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ef10-37ba-4b97-acf5-0015c5f2e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.371125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ef10-37ba-4b97-acf5-0015c5f2e54e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.371375 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ef10-37ba-4b97-acf5-0015c5f2e54e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.371684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410ef10-37ba-4b97-acf5-0015c5f2e54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.383587 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410ef10-37ba-4b97-acf5-0015c5f2e54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.385100 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410ef10-37ba-4b97-acf5-0015c5f2e54e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-6410ef10-37ba-4b97-acf5-0015c5f2e54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:47.405343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:47.406236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:47.407105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:47.407105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:47.407105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:47.407105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:47.407105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 247/485] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:47.408186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ef10-37ba-4b97-acf5-0015c5f2e54e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.436174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.456530 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc58849-5e73-4796-b343-9124f6371608 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.490977 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ac98d-a23d-49a8-adb6-74e7107a120c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.491783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac98d-a23d-49a8-adb6-74e7107a120c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.492063 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac98d-a23d-49a8-adb6-74e7107a120c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.492339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ac98d-a23d-49a8-adb6-74e7107a120c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.503208 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120ac98d-a23d-49a8-adb6-74e7107a120c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:47.510457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410ef10-37ba-4b97-acf5-0015c5f2e54e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-120ac98d-a23d-49a8-adb6-74e7107a120c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:47.510814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:47.511712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:47.512507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 239/486] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:47.513154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ac98d-a23d-49a8-adb6-74e7107a120c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.545755 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f51a2-a180-4512-bad5-84f4beade66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.546438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f51a2-a180-4512-bad5-84f4beade66a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.546727 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f51a2-a180-4512-bad5-84f4beade66a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.547003 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f51a2-a180-4512-bad5-84f4beade66a None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.547800 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f51a2-a180-4512-bad5-84f4beade66a None admin] RBAC: Adding query filter params (name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:47.548112 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f51a2-a180-4512-bad5-84f4beade66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.549541 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f51a2-a180-4512-bad5-84f4beade66a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.551727 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.558197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 248/487] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:47.559670 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2f5e7-c2a2-48ec-83dd-eb8f08a6789d None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.559958 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2f5e7-c2a2-48ec-83dd-eb8f08a6789d None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.560228 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2f5e7-c2a2-48ec-83dd-eb8f08a6789d None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.561493 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 249/488] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:47.562184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2f5e7-c2a2-48ec-83dd-eb8f08a6789d None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.617899 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ac98d-a23d-49a8-adb6-74e7107a120c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.650987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8534a5b-ae1f-4c49-8231-b1dabf298e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.651650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8534a5b-ae1f-4c49-8231-b1dabf298e98 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.651956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8534a5b-ae1f-4c49-8231-b1dabf298e98 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.652217 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8534a5b-ae1f-4c49-8231-b1dabf298e98 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.652942 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8534a5b-ae1f-4c49-8231-b1dabf298e98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:47.653249 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8534a5b-ae1f-4c49-8231-b1dabf298e98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.654742 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8534a5b-ae1f-4c49-8231-b1dabf298e98 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.664164 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.664933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2f5e7-c2a2-48ec-83dd-eb8f08a6789d None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.670789 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 240/489] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:47.671642 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8534a5b-ae1f-4c49-8231-b1dabf298e98 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.700269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0c5bf-24ab-4bd1-8fca-4b1db87e62f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.700847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0c5bf-24ab-4bd1-8fca-4b1db87e62f5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.701129 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0c5bf-24ab-4bd1-8fca-4b1db87e62f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.701435 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0c5bf-24ab-4bd1-8fca-4b1db87e62f5 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.702172 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0c5bf-24ab-4bd1-8fca-4b1db87e62f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:47.702508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0c5bf-24ab-4bd1-8fca-4b1db87e62f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.703907 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0c5bf-24ab-4bd1-8fca-4b1db87e62f5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.711848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 250/490] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:47.713040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c65d55-16ee-4641-a4e9-26421bb1f601 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.713328 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c65d55-16ee-4641-a4e9-26421bb1f601 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.713602 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c65d55-16ee-4641-a4e9-26421bb1f601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.730653 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-90c65d55-16ee-4641-a4e9-26421bb1f601 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:47.731851 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-90c65d55-16ee-4641-a4e9-26421bb1f601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:47.777297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8534a5b-ae1f-4c49-8231-b1dabf298e98 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.786394 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.798365 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 251/491] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:47.799365 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c65d55-16ee-4641-a4e9-26421bb1f601 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.824444 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b5d4d-146f-442e-835d-56b5763236bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.825209 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5d4d-146f-442e-835d-56b5763236bd None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.825494 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5d4d-146f-442e-835d-56b5763236bd None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.825768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b5d4d-146f-442e-835d-56b5763236bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.836037 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5d4d-146f-442e-835d-56b5763236bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.837488 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b5d4d-146f-442e-835d-56b5763236bd None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-8d7b5d4d-146f-442e-835d-56b5763236bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:47.855154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:47.856005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:47.856864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:47.856864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:47.856864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:47.856864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:47.856864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 241/492] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:47.857119 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b5d4d-146f-442e-835d-56b5763236bd None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.904479 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c65d55-16ee-4641-a4e9-26421bb1f601 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.908763 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:47.938095 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa391a8-76d9-42e3-89c4-c797a3244f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:47.938930 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa391a8-76d9-42e3-89c4-c797a3244f29 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:47.939212 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa391a8-76d9-42e3-89c4-c797a3244f29 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:47.939482 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa391a8-76d9-42e3-89c4-c797a3244f29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:47.947345 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa391a8-76d9-42e3-89c4-c797a3244f29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:47.948828 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa391a8-76d9-42e3-89c4-c797a3244f29 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:47.962981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b5d4d-146f-442e-835d-56b5763236bd None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-ffa391a8-76d9-42e3-89c4-c797a3244f29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:35:47.965477 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:47.966366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:47.967377 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 252/493] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:47.968429 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa391a8-76d9-42e3-89c4-c797a3244f29 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:47.999260 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393600cd-5182-4500-988a-e454222deb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.000057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393600cd-5182-4500-988a-e454222deb9b None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.000342 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393600cd-5182-4500-988a-e454222deb9b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.000622 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393600cd-5182-4500-988a-e454222deb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.011048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393600cd-5182-4500-988a-e454222deb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.012505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393600cd-5182-4500-988a-e454222deb9b None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.016662 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-393600cd-5182-4500-988a-e454222deb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:48.029840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:48.030754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:48.036134 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:48.036134 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:48.036134 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:48.036134 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:48.036134 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 242/494] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:48.036134 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393600cd-5182-4500-988a-e454222deb9b None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.066653 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa391a8-76d9-42e3-89c4-c797a3244f29 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.100974 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c897d91-d58b-4017-a603-aa0401540f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.101780 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c897d91-d58b-4017-a603-aa0401540f73 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.102069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c897d91-d58b-4017-a603-aa0401540f73 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.102346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c897d91-d58b-4017-a603-aa0401540f73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.112420 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c897d91-d58b-4017-a603-aa0401540f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-2c897d91-d58b-4017-a603-aa0401540f73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:48.120211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:48.121064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 253/495] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:48.127074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c897d91-d58b-4017-a603-aa0401540f73 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.135841 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393600cd-5182-4500-988a-e454222deb9b None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.138137 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:48.169596 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca2c19-7249-42a6-94f9-434dcbb0a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.170568 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2c19-7249-42a6-94f9-434dcbb0a332 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.170840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2c19-7249-42a6-94f9-434dcbb0a332 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.171136 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca2c19-7249-42a6-94f9-434dcbb0a332 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.171846 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca2c19-7249-42a6-94f9-434dcbb0a332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:48.172144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca2c19-7249-42a6-94f9-434dcbb0a332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.173515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca2c19-7249-42a6-94f9-434dcbb0a332 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.184651 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 243/496] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:48.185660 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca2c19-7249-42a6-94f9-434dcbb0a332 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.227105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c897d91-d58b-4017-a603-aa0401540f73 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.237409 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:48.260874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f944-e8ff-41d7-a1d2-f1e8442c20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.261532 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f944-e8ff-41d7-a1d2-f1e8442c20c2 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.261792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f944-e8ff-41d7-a1d2-f1e8442c20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.262065 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f944-e8ff-41d7-a1d2-f1e8442c20c2 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.262930 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4f944-e8ff-41d7-a1d2-f1e8442c20c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:48.263241 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4f944-e8ff-41d7-a1d2-f1e8442c20c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.264745 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4f944-e8ff-41d7-a1d2-f1e8442c20c2 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.283627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca2c19-7249-42a6-94f9-434dcbb0a332 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.300804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 254/497] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:48.301655 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f944-e8ff-41d7-a1d2-f1e8442c20c2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.316596 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cdc1a-8d2e-4ada-9f6c-cde8b8b95921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.317243 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cdc1a-8d2e-4ada-9f6c-cde8b8b95921 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.317509 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cdc1a-8d2e-4ada-9f6c-cde8b8b95921 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.317783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6cdc1a-8d2e-4ada-9f6c-cde8b8b95921 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.318525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cdc1a-8d2e-4ada-9f6c-cde8b8b95921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:48.318890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cdc1a-8d2e-4ada-9f6c-cde8b8b95921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.320263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6cdc1a-8d2e-4ada-9f6c-cde8b8b95921 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.331920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 244/498] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:48.332714 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cdc1a-8d2e-4ada-9f6c-cde8b8b95921 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.357651 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:48.405889 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f944-e8ff-41d7-a1d2-f1e8442c20c2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.431937 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6cdc1a-8d2e-4ada-9f6c-cde8b8b95921 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.439337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078937-1281-41d1-9e23-39ec924ed6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.440092 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078937-1281-41d1-9e23-39ec924ed6b1 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.440387 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078937-1281-41d1-9e23-39ec924ed6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.440669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52078937-1281-41d1-9e23-39ec924ed6b1 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.441417 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52078937-1281-41d1-9e23-39ec924ed6b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:48.441730 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52078937-1281-41d1-9e23-39ec924ed6b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.443245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52078937-1281-41d1-9e23-39ec924ed6b1 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.451637 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 255/499] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:48.452439 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078937-1281-41d1-9e23-39ec924ed6b1 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.465976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f07c8-77e5-4e02-88bc-b18de01d3261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.466828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f07c8-77e5-4e02-88bc-b18de01d3261 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.467181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f07c8-77e5-4e02-88bc-b18de01d3261 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.467755 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f07c8-77e5-4e02-88bc-b18de01d3261 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.475106 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f07c8-77e5-4e02-88bc-b18de01d3261 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.476570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31f07c8-77e5-4e02-88bc-b18de01d3261 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.486583 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-a31f07c8-77e5-4e02-88bc-b18de01d3261 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:35:48.492276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:48.493194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:48.494090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 245/500] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:48.494702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f07c8-77e5-4e02-88bc-b18de01d3261 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.555850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52078937-1281-41d1-9e23-39ec924ed6b1 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.580787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:48.588720 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e3f5c-6cc5-4d34-8f4c-9e61d3d354c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.589370 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e3f5c-6cc5-4d34-8f4c-9e61d3d354c7 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.589651 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e3f5c-6cc5-4d34-8f4c-9e61d3d354c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.589930 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e3f5c-6cc5-4d34-8f4c-9e61d3d354c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.601058 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f07c8-77e5-4e02-88bc-b18de01d3261 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.635399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4bd86-d0ea-4b7a-b819-d29a60196871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.636186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4bd86-d0ea-4b7a-b819-d29a60196871 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.636464 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4bd86-d0ea-4b7a-b819-d29a60196871 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.636736 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4bd86-d0ea-4b7a-b819-d29a60196871 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.643797 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4bd86-d0ea-4b7a-b819-d29a60196871 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.645262 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4bd86-d0ea-4b7a-b819-d29a60196871 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.657407 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e3f5c-6cc5-4d34-8f4c-9e61d3d354c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.658916 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e3f5c-6cc5-4d34-8f4c-9e61d3d354c7 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-22a4bd86-d0ea-4b7a-b819-d29a60196871 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:35:48.659500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:48.660355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:48.661211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 246/501] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:48.661751 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4bd86-d0ea-4b7a-b819-d29a60196871 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.693052 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:48.760720 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4bd86-d0ea-4b7a-b819-d29a60196871 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.764625 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 256/502] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:48.765453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e3f5c-6cc5-4d34-8f4c-9e61d3d354c7 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.797005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692f2bd-f42e-4c50-a10b-6825666a8dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.797887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692f2bd-f42e-4c50-a10b-6825666a8dc7 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.798239 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692f2bd-f42e-4c50-a10b-6825666a8dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.798618 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692f2bd-f42e-4c50-a10b-6825666a8dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.809646 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692f2bd-f42e-4c50-a10b-6825666a8dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.811823 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692f2bd-f42e-4c50-a10b-6825666a8dc7 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.814722 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-d692f2bd-f42e-4c50-a10b-6825666a8dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:48.831216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:48.832211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:48.833310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:48.833310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:48.833310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:48.833310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:48.833310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 247/503] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:48.833310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692f2bd-f42e-4c50-a10b-6825666a8dc7 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.867908 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e3f5c-6cc5-4d34-8f4c-9e61d3d354c7 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.895786 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:48.901482 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2981157-f64d-4192-ae06-7afb2d60fbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.902152 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2981157-f64d-4192-ae06-7afb2d60fbf3 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.902501 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2981157-f64d-4192-ae06-7afb2d60fbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.902729 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2981157-f64d-4192-ae06-7afb2d60fbf3 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.903563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2981157-f64d-4192-ae06-7afb2d60fbf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:48.903871 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2981157-f64d-4192-ae06-7afb2d60fbf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.905588 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2981157-f64d-4192-ae06-7afb2d60fbf3 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:48.923642 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 257/504] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:48.924811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2981157-f64d-4192-ae06-7afb2d60fbf3 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:48.940233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692f2bd-f42e-4c50-a10b-6825666a8dc7 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:48.975367 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc8ee3-55cb-4228-8069-cc7003cfe507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:48.976034 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8ee3-55cb-4228-8069-cc7003cfe507 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:48.976349 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8ee3-55cb-4228-8069-cc7003cfe507 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:48.976627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc8ee3-55cb-4228-8069-cc7003cfe507 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:48.977464 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc8ee3-55cb-4228-8069-cc7003cfe507 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:48.977780 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc8ee3-55cb-4228-8069-cc7003cfe507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:48.979300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc8ee3-55cb-4228-8069-cc7003cfe507 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.015446 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 248/505] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:49.016206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc8ee3-55cb-4228-8069-cc7003cfe507 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.028751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2981157-f64d-4192-ae06-7afb2d60fbf3 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.062952 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede45f5-1590-4b79-8958-26537d4210d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.063748 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede45f5-1590-4b79-8958-26537d4210d5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.064029 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede45f5-1590-4b79-8958-26537d4210d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.064305 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede45f5-1590-4b79-8958-26537d4210d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.074562 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.074850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede45f5-1590-4b79-8958-26537d4210d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:49.076472 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede45f5-1590-4b79-8958-26537d4210d5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-1ede45f5-1590-4b79-8958-26537d4210d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:49.095397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:49.096322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:49.097229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:49.097229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:49.097229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:49.097229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:49.097229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 258/506] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:49.097479 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede45f5-1590-4b79-8958-26537d4210d5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.127746 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc8ee3-55cb-4228-8069-cc7003cfe507 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.145584 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.161766 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110dddb-dad0-44eb-aa84-54e3c10d2da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.162461 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110dddb-dad0-44eb-aa84-54e3c10d2da5 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.162752 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110dddb-dad0-44eb-aa84-54e3c10d2da5 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.163034 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110dddb-dad0-44eb-aa84-54e3c10d2da5 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.163770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110dddb-dad0-44eb-aa84-54e3c10d2da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:49.164080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110dddb-dad0-44eb-aa84-54e3c10d2da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:49.165489 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110dddb-dad0-44eb-aa84-54e3c10d2da5 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.177220 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 249/507] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:49.178025 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110dddb-dad0-44eb-aa84-54e3c10d2da5 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.206010 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede45f5-1590-4b79-8958-26537d4210d5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.239153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b85f39-cff1-4926-8714-ae373587a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.239794 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b85f39-cff1-4926-8714-ae373587a416 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.240078 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b85f39-cff1-4926-8714-ae373587a416 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.240352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b85f39-cff1-4926-8714-ae373587a416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.276450 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110dddb-dad0-44eb-aa84-54e3c10d2da5 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.289807 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.308748 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b85f39-cff1-4926-8714-ae373587a416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:49.310233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b85f39-cff1-4926-8714-ae373587a416 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.310331 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6485b-33b5-4a59-a1d7-4b67fcdf3619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.311066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6485b-33b5-4a59-a1d7-4b67fcdf3619 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.311466 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6485b-33b5-4a59-a1d7-4b67fcdf3619 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.311750 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6485b-33b5-4a59-a1d7-4b67fcdf3619 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.387895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6485b-33b5-4a59-a1d7-4b67fcdf3619 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:49.389462 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6485b-33b5-4a59-a1d7-4b67fcdf3619 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.488931 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.501678 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 250/508] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:49.502588 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6485b-33b5-4a59-a1d7-4b67fcdf3619 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.517724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.553296 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 259/509] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:49.554075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b85f39-cff1-4926-8714-ae373587a416 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.603453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6485b-33b5-4a59-a1d7-4b67fcdf3619 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.636724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9fe4e-dfc8-47ef-a998-613233dd9670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.637376 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9fe4e-dfc8-47ef-a998-613233dd9670 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.637660 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9fe4e-dfc8-47ef-a998-613233dd9670 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.637934 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9fe4e-dfc8-47ef-a998-613233dd9670 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.638700 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9fe4e-dfc8-47ef-a998-613233dd9670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:49.639000 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9fe4e-dfc8-47ef-a998-613233dd9670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:49.640400 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9fe4e-dfc8-47ef-a998-613233dd9670 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.651409 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b85f39-cff1-4926-8714-ae373587a416 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.651556 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 251/510] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:49.652329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9fe4e-dfc8-47ef-a998-613233dd9670 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.688123 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a3164-6f71-49ba-a80c-33391ff40640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.689025 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a3164-6f71-49ba-a80c-33391ff40640 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.689373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a3164-6f71-49ba-a80c-33391ff40640 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.689729 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a3164-6f71-49ba-a80c-33391ff40640 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.697596 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a3164-6f71-49ba-a80c-33391ff40640 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:49.699132 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a3164-6f71-49ba-a80c-33391ff40640 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.701942 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-838a3164-6f71-49ba-a80c-33391ff40640 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:35:49.714040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:49.715020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:49.715875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 260/511] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:49.716960 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a3164-6f71-49ba-a80c-33391ff40640 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.736414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.762154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9fe4e-dfc8-47ef-a998-613233dd9670 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.795894 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af6a91-1841-41f0-bbfd-b75b761f7763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.796675 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af6a91-1841-41f0-bbfd-b75b761f7763 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.796955 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af6a91-1841-41f0-bbfd-b75b761f7763 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.797266 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af6a91-1841-41f0-bbfd-b75b761f7763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.808158 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af6a91-1841-41f0-bbfd-b75b761f7763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:49.809584 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af6a91-1841-41f0-bbfd-b75b761f7763 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.815286 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a3164-6f71-49ba-a80c-33391ff40640 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-12af6a91-1841-41f0-bbfd-b75b761f7763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:49.827649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:49.828490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:49.829338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:49.829338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:49.829338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:49.829338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:49.829338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 252/512] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:49.829782 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af6a91-1841-41f0-bbfd-b75b761f7763 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.856835 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ac2f-3f53-41be-ad85-3d354d995acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.857980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ac2f-3f53-41be-ad85-3d354d995acd None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.858251 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ac2f-3f53-41be-ad85-3d354d995acd None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.858572 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ac2f-3f53-41be-ad85-3d354d995acd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.869636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9ac2f-3f53-41be-ad85-3d354d995acd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:49.871167 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9ac2f-3f53-41be-ad85-3d354d995acd None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e5b9ac2f-3f53-41be-ad85-3d354d995acd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:49.888949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:49.889927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:49.890932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:49.890932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:49.890932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:49.890932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:49.890932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 261/513] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:49.891196 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ac2f-3f53-41be-ad85-3d354d995acd None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:49.933715 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af6a91-1841-41f0-bbfd-b75b761f7763 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.948012 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.963341 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:49.972527 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ffd9a-c884-485e-843b-9b196290fb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:49.973414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ffd9a-c884-485e-843b-9b196290fb36 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:49.973762 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ffd9a-c884-485e-843b-9b196290fb36 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:49.974045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ffd9a-c884-485e-843b-9b196290fb36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:49.980770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ffd9a-c884-485e-843b-9b196290fb36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:49.982248 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ffd9a-c884-485e-843b-9b196290fb36 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:49.996334 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9ac2f-3f53-41be-ad85-3d354d995acd None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-0c9ffd9a-c884-485e-843b-9b196290fb36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:35:49.997304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:49.998128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:49.999020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:35:49.999020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:35:49.999020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:35:49.999020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:35:49.999020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:35:49.999020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:35:49.999020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:49.999020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:49.999020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 253/514] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:49.999483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ffd9a-c884-485e-843b-9b196290fb36 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.034261 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c617e-f3e4-4cc6-8501-aee4a12f4493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.034969 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c617e-f3e4-4cc6-8501-aee4a12f4493 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.035255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c617e-f3e4-4cc6-8501-aee4a12f4493 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.035543 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c617e-f3e4-4cc6-8501-aee4a12f4493 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.036993 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c617e-f3e4-4cc6-8501-aee4a12f4493 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:50.036993 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c617e-f3e4-4cc6-8501-aee4a12f4493 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.038176 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c617e-f3e4-4cc6-8501-aee4a12f4493 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.059709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 262/515] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.059709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c617e-f3e4-4cc6-8501-aee4a12f4493 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.103275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ffd9a-c884-485e-843b-9b196290fb36 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.137014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0a36a-8665-4f9f-86d2-2ed7138ca497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.137677 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0a36a-8665-4f9f-86d2-2ed7138ca497 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.137956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0a36a-8665-4f9f-86d2-2ed7138ca497 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.138239 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0a36a-8665-4f9f-86d2-2ed7138ca497 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.139148 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0a36a-8665-4f9f-86d2-2ed7138ca497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:50.139451 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0a36a-8665-4f9f-86d2-2ed7138ca497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.140853 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0a36a-8665-4f9f-86d2-2ed7138ca497 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.152149 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 254/516] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.152974 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0a36a-8665-4f9f-86d2-2ed7138ca497 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.159677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c617e-f3e4-4cc6-8501-aee4a12f4493 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.171839 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.195864 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806cf42-36dc-4501-8c82-3c829a75173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.196519 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806cf42-36dc-4501-8c82-3c829a75173d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.196796 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806cf42-36dc-4501-8c82-3c829a75173d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.197072 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806cf42-36dc-4501-8c82-3c829a75173d None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.197787 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806cf42-36dc-4501-8c82-3c829a75173d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:50.198095 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806cf42-36dc-4501-8c82-3c829a75173d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.199529 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806cf42-36dc-4501-8c82-3c829a75173d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.199651 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.210702 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 263/517] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.211538 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806cf42-36dc-4501-8c82-3c829a75173d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.254732 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0a36a-8665-4f9f-86d2-2ed7138ca497 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.287088 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80837d08-b406-48f1-9552-7cb9fd4ae1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.287749 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80837d08-b406-48f1-9552-7cb9fd4ae1bd None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.288035 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80837d08-b406-48f1-9552-7cb9fd4ae1bd None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.288314 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80837d08-b406-48f1-9552-7cb9fd4ae1bd None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.289124 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80837d08-b406-48f1-9552-7cb9fd4ae1bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:50.289436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80837d08-b406-48f1-9552-7cb9fd4ae1bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.290934 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80837d08-b406-48f1-9552-7cb9fd4ae1bd None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.308129 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806cf42-36dc-4501-8c82-3c829a75173d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.308284 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 255/518] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.309094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80837d08-b406-48f1-9552-7cb9fd4ae1bd None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.344224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de063435-b5a7-4710-bea9-ce1d90ab980e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.344796 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de063435-b5a7-4710-bea9-ce1d90ab980e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.345073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de063435-b5a7-4710-bea9-ce1d90ab980e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.345348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de063435-b5a7-4710-bea9-ce1d90ab980e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.383642 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.408684 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80837d08-b406-48f1-9552-7cb9fd4ae1bd None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.412119 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de063435-b5a7-4710-bea9-ce1d90ab980e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.413579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de063435-b5a7-4710-bea9-ce1d90ab980e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.415965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.443303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e6839-a2ae-4fc3-92c3-884725ccff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.444090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6839-a2ae-4fc3-92c3-884725ccff0c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.444377 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6839-a2ae-4fc3-92c3-884725ccff0c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.444654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e6839-a2ae-4fc3-92c3-884725ccff0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.451323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e6839-a2ae-4fc3-92c3-884725ccff0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.452712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e6839-a2ae-4fc3-92c3-884725ccff0c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-668e6839-a2ae-4fc3-92c3-884725ccff0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:35:50.466679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:50.468238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:50.469061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:35:50.469061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:35:50.469061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:35:50.469061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:35:50.469061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:35:50.469061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:35:50.469061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:50.469061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:50.469061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 256/519] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:50.470082 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e6839-a2ae-4fc3-92c3-884725ccff0c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.517571 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 264/520] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:50.518658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de063435-b5a7-4710-bea9-ce1d90ab980e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.577376 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e6839-a2ae-4fc3-92c3-884725ccff0c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.590719 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.611415 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185aaa1-993e-4663-9413-2431b5b8732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.612143 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185aaa1-993e-4663-9413-2431b5b8732d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.612430 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185aaa1-993e-4663-9413-2431b5b8732d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.612707 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185aaa1-993e-4663-9413-2431b5b8732d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.619323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185aaa1-993e-4663-9413-2431b5b8732d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.620799 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185aaa1-993e-4663-9413-2431b5b8732d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.623221 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de063435-b5a7-4710-bea9-ce1d90ab980e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-f185aaa1-993e-4663-9413-2431b5b8732d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:35:50.635027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:50.635840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:50.636946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:35:50.636946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:35:50.636946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:35:50.636946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:35:50.636946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:35:50.636946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:35:50.636946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:50.636946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:50.636946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 257/521] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:50.637797 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185aaa1-993e-4663-9413-2431b5b8732d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.659536 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d22a7-001f-43a4-b334-57788d0008fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.660205 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d22a7-001f-43a4-b334-57788d0008fc None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.660496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d22a7-001f-43a4-b334-57788d0008fc None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.660781 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d22a7-001f-43a4-b334-57788d0008fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.661613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d22a7-001f-43a4-b334-57788d0008fc None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=bf16c49c506a4f5c86e3538cd3ed12be) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:50.661933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d22a7-001f-43a4-b334-57788d0008fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.663415 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d22a7-001f-43a4-b334-57788d0008fc None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.663976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.669010 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 265/522] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/role_assignments?user.id=bf16c49c506a4f5c86e3538cd3ed12be&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.670072 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d22a7-001f-43a4-b334-57788d0008fc None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.757397 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185aaa1-993e-4663-9413-2431b5b8732d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.785362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d22a7-001f-43a4-b334-57788d0008fc None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.801204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f491eb-1b82-49ee-af7d-53a80f601e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.801954 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f491eb-1b82-49ee-af7d-53a80f601e54 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.802311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f491eb-1b82-49ee-af7d-53a80f601e54 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.802730 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f491eb-1b82-49ee-af7d-53a80f601e54 None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.803622 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f491eb-1b82-49ee-af7d-53a80f601e54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:50.804040 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f491eb-1b82-49ee-af7d-53a80f601e54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.805603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f491eb-1b82-49ee-af7d-53a80f601e54 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.824132 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 258/523] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:50.824132 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f491eb-1b82-49ee-af7d-53a80f601e54 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.832359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4d31a-3752-4bdf-9159-a459a5a4bffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.834351 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d31a-3752-4bdf-9159-a459a5a4bffc None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.834858 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d31a-3752-4bdf-9159-a459a5a4bffc None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.835283 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d31a-3752-4bdf-9159-a459a5a4bffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.839475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.852663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4d31a-3752-4bdf-9159-a459a5a4bffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.854203 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4d31a-3752-4bdf-9159-a459a5a4bffc None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-aac4d31a-3752-4bdf-9159-a459a5a4bffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:50.874362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:50.875391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:50.881044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:50.881044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:50.881044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:50.881044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:50.881044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 266/524] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:50.881044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4d31a-3752-4bdf-9159-a459a5a4bffc None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:50.939644 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:50.957477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f491eb-1b82-49ee-af7d-53a80f601e54 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.987372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4d31a-3752-4bdf-9159-a459a5a4bffc None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:50.994216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fc144-72f4-4f50-883c-a0830c81565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:50.994973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc144-72f4-4f50-883c-a0830c81565e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:50.995262 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc144-72f4-4f50-883c-a0830c81565e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:50.995541 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fc144-72f4-4f50-883c-a0830c81565e None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:50.996481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc144-72f4-4f50-883c-a0830c81565e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:50.996795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc144-72f4-4f50-883c-a0830c81565e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:50.998707 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fc144-72f4-4f50-883c-a0830c81565e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.012241 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 259/525] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:51.012876 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fc144-72f4-4f50-883c-a0830c81565e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.027582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e6009-09fe-4864-be6e-3a16dda39346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.028239 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e6009-09fe-4864-be6e-3a16dda39346 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.028523 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e6009-09fe-4864-be6e-3a16dda39346 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.028792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e6009-09fe-4864-be6e-3a16dda39346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.029956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e6009-09fe-4864-be6e-3a16dda39346 None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=fc0920a9a54d4d839f1e2125431e9d19) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:51.030267 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e6009-09fe-4864-be6e-3a16dda39346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.031783 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0e6009-09fe-4864-be6e-3a16dda39346 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.037388 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 267/526] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:50 2022] GET /identity/v3/role_assignments?user.id=fc0920a9a54d4d839f1e2125431e9d19&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:51.038249 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e6009-09fe-4864-be6e-3a16dda39346 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.104362 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.130947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fc144-72f4-4f50-883c-a0830c81565e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.172349 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230d5e-e0b4-4b6f-944c-00b74b16d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.173029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230d5e-e0b4-4b6f-944c-00b74b16d2aa None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.173314 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230d5e-e0b4-4b6f-944c-00b74b16d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.173587 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30230d5e-e0b4-4b6f-944c-00b74b16d2aa None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.174322 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230d5e-e0b4-4b6f-944c-00b74b16d2aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:51.174738 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230d5e-e0b4-4b6f-944c-00b74b16d2aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.176146 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30230d5e-e0b4-4b6f-944c-00b74b16d2aa None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.181488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0e6009-09fe-4864-be6e-3a16dda39346 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.194521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 260/527] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:51.195237 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230d5e-e0b4-4b6f-944c-00b74b16d2aa None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.206887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.229804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393781ab-52f3-4e63-b504-e70745394aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.231562 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393781ab-52f3-4e63-b504-e70745394aa8 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.232063 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393781ab-52f3-4e63-b504-e70745394aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.232594 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393781ab-52f3-4e63-b504-e70745394aa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.233773 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393781ab-52f3-4e63-b504-e70745394aa8 None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=7e58f00fa06e4a1ca16f5f8eba3dfb0e) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:51.234291 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393781ab-52f3-4e63-b504-e70745394aa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.236774 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393781ab-52f3-4e63-b504-e70745394aa8 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.244167 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 268/528] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/role_assignments?user.id=7e58f00fa06e4a1ca16f5f8eba3dfb0e&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:51.323801 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30230d5e-e0b4-4b6f-944c-00b74b16d2aa None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.363860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31473b-c454-433b-b5d5-4f973aaccba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.364989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31473b-c454-433b-b5d5-4f973aaccba4 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.365457 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31473b-c454-433b-b5d5-4f973aaccba4 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.365915 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31473b-c454-433b-b5d5-4f973aaccba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.374263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31473b-c454-433b-b5d5-4f973aaccba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.376061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31473b-c454-433b-b5d5-4f973aaccba4 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-7c31473b-c454-433b-b5d5-4f973aaccba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:35:51.392635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:51.393689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:51.394710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:35:51.394710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:35:51.394710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:35:51.394710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:35:51.394710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:35:51.394710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:35:51.394710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:51.394710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:51.396957 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 261/529] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:51.402844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393781ab-52f3-4e63-b504-e70745394aa8 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.511621 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393781ab-52f3-4e63-b504-e70745394aa8 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.526079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.547436 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ba133-7371-4c66-9462-65b04e2583e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.548458 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ba133-7371-4c66-9462-65b04e2583e1 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.548930 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ba133-7371-4c66-9462-65b04e2583e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.549346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ba133-7371-4c66-9462-65b04e2583e1 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.550286 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ba133-7371-4c66-9462-65b04e2583e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:51.550782 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ba133-7371-4c66-9462-65b04e2583e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.552378 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ba133-7371-4c66-9462-65b04e2583e1 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.571040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 269/530] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:51.577140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31473b-c454-433b-b5d5-4f973aaccba4 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:51.647414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:51.683852 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31473b-c454-433b-b5d5-4f973aaccba4 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:51.720330 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a1e77-a577-404f-9f07-d101087f0846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:51.721363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a1e77-a577-404f-9f07-d101087f0846 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:51.721839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a1e77-a577-404f-9f07-d101087f0846 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:51.722318 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a1e77-a577-404f-9f07-d101087f0846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:51.723355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a1e77-a577-404f-9f07-d101087f0846 None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=6ddd2eb988484d7ab0e64323fe4f4602) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:51.723879 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a1e77-a577-404f-9f07-d101087f0846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:51.725518 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139a1e77-a577-404f-9f07-d101087f0846 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:51.731951 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 262/531] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:35:51 2022] GET /identity/v3/role_assignments?user.id=6ddd2eb988484d7ab0e64323fe4f4602&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:53.011018 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef174-fa62-4599-9d95-1ca28d5c6582 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.011533 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef174-fa62-4599-9d95-1ca28d5c6582 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.011608 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ef174-fa62-4599-9d95-1ca28d5c6582 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.013136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 270/532] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:53.018937 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15393a3-332d-4756-9c42-fb09bdb42efd None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.019403 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15393a3-332d-4756-9c42-fb09bdb42efd None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.019481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15393a3-332d-4756-9c42-fb09bdb42efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.037079 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-a15393a3-332d-4756-9c42-fb09bdb42efd None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:53.038255 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-a15393a3-332d-4756-9c42-fb09bdb42efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:53.106826 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 263/533] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:53.131693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ef174-fa62-4599-9d95-1ca28d5c6582 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.236936 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ef174-fa62-4599-9d95-1ca28d5c6582 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.271416 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b76a7-2433-4afe-aac5-162084f93f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.272220 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b76a7-2433-4afe-aac5-162084f93f2a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.272504 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b76a7-2433-4afe-aac5-162084f93f2a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.272780 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b76a7-2433-4afe-aac5-162084f93f2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.283416 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b76a7-2433-4afe-aac5-162084f93f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-b73b76a7-2433-4afe-aac5-162084f93f2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:53.291204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:53.292080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:53.292872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 271/534] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:53.298858 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15393a3-332d-4756-9c42-fb09bdb42efd None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.362147 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.365186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c3931-216b-4a43-ac44-323424f80b4b None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.365776 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c3931-216b-4a43-ac44-323424f80b4b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.366261 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c3931-216b-4a43-ac44-323424f80b4b None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.368518 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 272/535] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:53.373991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7441b8-4d54-4b9a-9b80-c23339de70cd None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.374275 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7441b8-4d54-4b9a-9b80-c23339de70cd None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.375184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7441b8-4d54-4b9a-9b80-c23339de70cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.392870 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-7f7441b8-4d54-4b9a-9b80-c23339de70cd None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:53.394081 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-7f7441b8-4d54-4b9a-9b80-c23339de70cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:53.411972 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15393a3-332d-4756-9c42-fb09bdb42efd None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.423082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.453548 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156196f-0fc9-4521-99a6-5bf0d8a1bc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.454231 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156196f-0fc9-4521-99a6-5bf0d8a1bc83 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.454548 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156196f-0fc9-4521-99a6-5bf0d8a1bc83 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.454828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156196f-0fc9-4521-99a6-5bf0d8a1bc83 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.455581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156196f-0fc9-4521-99a6-5bf0d8a1bc83 None admin] RBAC: Adding query filter params (name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:53.455891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156196f-0fc9-4521-99a6-5bf0d8a1bc83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.457739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156196f-0fc9-4521-99a6-5bf0d8a1bc83 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.474151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 264/536] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:53.474365 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 273/537] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:35:53.475688 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156196f-0fc9-4521-99a6-5bf0d8a1bc83 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.497278 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7441b8-4d54-4b9a-9b80-c23339de70cd None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.598314 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156196f-0fc9-4521-99a6-5bf0d8a1bc83 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.607705 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7441b8-4d54-4b9a-9b80-c23339de70cd None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.622959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.636346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fc098-4457-4913-a287-013814d75fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.637320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc098-4457-4913-a287-013814d75fae None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.637606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc098-4457-4913-a287-013814d75fae None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.637881 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc098-4457-4913-a287-013814d75fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.646322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da647ae0-9bed-4a85-b390-914117d3bb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.647517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da647ae0-9bed-4a85-b390-914117d3bb5e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.647810 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da647ae0-9bed-4a85-b390-914117d3bb5e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.648086 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da647ae0-9bed-4a85-b390-914117d3bb5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.649477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc098-4457-4913-a287-013814d75fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.650983 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc098-4457-4913-a287-013814d75fae None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.659505 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da647ae0-9bed-4a85-b390-914117d3bb5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-da647ae0-9bed-4a85-b390-914117d3bb5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:53.667461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:53.668496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:53.669449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-0b8fc098-4457-4913-a287-013814d75fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:53.670203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:53.671221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:53.672246 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:53.672246 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:53.672246 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:53.672246 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:53.673974 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 265/538] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:53.674292 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 274/539] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:53.675284 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da647ae0-9bed-4a85-b390-914117d3bb5e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.675381 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b735a4-86c6-4b3c-b35f-2b0f26ddf001 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.675573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b735a4-86c6-4b3c-b35f-2b0f26ddf001 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.675850 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b735a4-86c6-4b3c-b35f-2b0f26ddf001 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.677282 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 266/540] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:53.679359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b735a4-86c6-4b3c-b35f-2b0f26ddf001 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.708223 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.784133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da647ae0-9bed-4a85-b390-914117d3bb5e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.794813 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b735a4-86c6-4b3c-b35f-2b0f26ddf001 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:53.818616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a527e5-26c3-4548-bcf1-87b35798a0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.819285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a527e5-26c3-4548-bcf1-87b35798a0ba None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.819571 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a527e5-26c3-4548-bcf1-87b35798a0ba None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.819845 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a527e5-26c3-4548-bcf1-87b35798a0ba None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.820555 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a527e5-26c3-4548-bcf1-87b35798a0ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:53.820863 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a527e5-26c3-4548-bcf1-87b35798a0ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.822253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a527e5-26c3-4548-bcf1-87b35798a0ba None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.832065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f25c2-3ee4-4672-960d-207644c29d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:53.833078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f25c2-3ee4-4672-960d-207644c29d93 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.833536 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f25c2-3ee4-4672-960d-207644c29d93 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.834001 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f25c2-3ee4-4672-960d-207644c29d93 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.834453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 275/541] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:53.835246 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f25c2-3ee4-4672-960d-207644c29d93 None admin] RBAC: Adding query filter params (name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:53.835784 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d1c0-e494-4255-bafa-4e6164025212 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:53.836075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d1c0-e494-4255-bafa-4e6164025212 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:53.836176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f25c2-3ee4-4672-960d-207644c29d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:53.836347 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747d1c0-e494-4255-bafa-4e6164025212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:53.837926 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f25c2-3ee4-4672-960d-207644c29d93 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:53.849748 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 267/542] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:53.851108 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f25c2-3ee4-4672-960d-207644c29d93 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.859028 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-d747d1c0-e494-4255-bafa-4e6164025212 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:53.860258 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-d747d1c0-e494-4255-bafa-4e6164025212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:53.894057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.940730 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 276/543] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:53.941811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d1c0-e494-4255-bafa-4e6164025212 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:53.960476 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:53.998376 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f25c2-3ee4-4672-960d-207644c29d93 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.034980 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536bfb5-5328-4b41-b565-fa27b3a02f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.035726 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536bfb5-5328-4b41-b565-fa27b3a02f83 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.035983 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536bfb5-5328-4b41-b565-fa27b3a02f83 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.036251 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536bfb5-5328-4b41-b565-fa27b3a02f83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.044104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536bfb5-5328-4b41-b565-fa27b3a02f83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.046037 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536bfb5-5328-4b41-b565-fa27b3a02f83 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.056097 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747d1c0-e494-4255-bafa-4e6164025212 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-e536bfb5-5328-4b41-b565-fa27b3a02f83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:35:54.060477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:54.061335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:35:54.062204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:54.062741 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 268/544] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:54.063604 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536bfb5-5328-4b41-b565-fa27b3a02f83 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.093925 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94a70e-e33b-487c-8e10-4a676b2529af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.094763 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94a70e-e33b-487c-8e10-4a676b2529af None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.095054 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94a70e-e33b-487c-8e10-4a676b2529af None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.095336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94a70e-e33b-487c-8e10-4a676b2529af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.105484 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94a70e-e33b-487c-8e10-4a676b2529af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.107021 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94a70e-e33b-487c-8e10-4a676b2529af None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-5c94a70e-e33b-487c-8e10-4a676b2529af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:54.125946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:54.126829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:54.127638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:54.127638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:54.127638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:54.127638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:54.127638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 277/545] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:54.127980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94a70e-e33b-487c-8e10-4a676b2529af None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.167748 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.175749 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536bfb5-5328-4b41-b565-fa27b3a02f83 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.196675 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.209957 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ca914-698c-4d6d-b011-57e2de940306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.210788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca914-698c-4d6d-b011-57e2de940306 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.211073 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca914-698c-4d6d-b011-57e2de940306 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.211379 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ca914-698c-4d6d-b011-57e2de940306 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.231571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ca914-698c-4d6d-b011-57e2de940306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-b64ca914-698c-4d6d-b011-57e2de940306 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:54.240398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:54.241323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:54.242080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:54.245525 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94a70e-e33b-487c-8e10-4a676b2529af None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.255798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 269/546] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:54.255798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8a138-3d8d-43e0-8968-1dd98e06d029 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.255798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8a138-3d8d-43e0-8968-1dd98e06d029 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.255798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8a138-3d8d-43e0-8968-1dd98e06d029 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.255798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 270/547] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:54.255798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8a138-3d8d-43e0-8968-1dd98e06d029 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.288304 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121337-78a2-4345-bed3-aa1691907ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.288906 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121337-78a2-4345-bed3-aa1691907ca0 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.289191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121337-78a2-4345-bed3-aa1691907ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.289473 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121337-78a2-4345-bed3-aa1691907ca0 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.290316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31121337-78a2-4345-bed3-aa1691907ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:54.290669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31121337-78a2-4345-bed3-aa1691907ca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.292125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31121337-78a2-4345-bed3-aa1691907ca0 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.310889 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 278/548] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:54.311723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121337-78a2-4345-bed3-aa1691907ca0 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.371292 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8a138-3d8d-43e0-8968-1dd98e06d029 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.407580 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902f204-672b-406c-b114-7d10656c551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.408224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f204-672b-406c-b114-7d10656c551e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.408506 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f204-672b-406c-b114-7d10656c551e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.408788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902f204-672b-406c-b114-7d10656c551e None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.409515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f204-672b-406c-b114-7d10656c551e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:54.409811 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f204-672b-406c-b114-7d10656c551e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.411273 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902f204-672b-406c-b114-7d10656c551e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.411942 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121337-78a2-4345-bed3-aa1691907ca0 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.424172 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 271/549] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:54.425460 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf925b-cacb-4411-818d-e7e275a388c0 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.425744 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf925b-cacb-4411-818d-e7e275a388c0 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.426027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf925b-cacb-4411-818d-e7e275a388c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.435984 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.442794 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-a3cf925b-cacb-4411-818d-e7e275a388c0 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:54.444011 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-a3cf925b-cacb-4411-818d-e7e275a388c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:54.447118 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c66f7-c6ae-4253-88f0-20e3ea42cbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.447763 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c66f7-c6ae-4253-88f0-20e3ea42cbc3 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.448052 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c66f7-c6ae-4253-88f0-20e3ea42cbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.448331 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c66f7-c6ae-4253-88f0-20e3ea42cbc3 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.449077 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c66f7-c6ae-4253-88f0-20e3ea42cbc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:54.449387 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c66f7-c6ae-4253-88f0-20e3ea42cbc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.450812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c66f7-c6ae-4253-88f0-20e3ea42cbc3 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.455360 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.459145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 279/550] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:54.459944 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c66f7-c6ae-4253-88f0-20e3ea42cbc3 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.520081 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 272/551] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:54.520857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf925b-cacb-4411-818d-e7e275a388c0 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.563156 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c66f7-c6ae-4253-88f0-20e3ea42cbc3 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.599408 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f54e7-5c92-44c0-bbaf-865524ee85ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.600210 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f54e7-5c92-44c0-bbaf-865524ee85ba None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.600501 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f54e7-5c92-44c0-bbaf-865524ee85ba None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.600794 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f54e7-5c92-44c0-bbaf-865524ee85ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.612058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f54e7-5c92-44c0-bbaf-865524ee85ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.613532 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f54e7-5c92-44c0-bbaf-865524ee85ba None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-418f54e7-5c92-44c0-bbaf-865524ee85ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:54.630277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:54.631308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:54.632701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:54.632701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:54.632701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:54.632701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:54.632908 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf925b-cacb-4411-818d-e7e275a388c0 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.632978 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 280/552] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:54.632978 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f54e7-5c92-44c0-bbaf-865524ee85ba None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.667970 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138c04f-8786-4121-8372-ff6050c81989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.668765 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138c04f-8786-4121-8372-ff6050c81989 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.669044 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138c04f-8786-4121-8372-ff6050c81989 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.669316 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138c04f-8786-4121-8372-ff6050c81989 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.671671 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.677484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138c04f-8786-4121-8372-ff6050c81989 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.679016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138c04f-8786-4121-8372-ff6050c81989 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-c138c04f-8786-4121-8372-ff6050c81989 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:35:54.693467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:54.694768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 273/553] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:54.700484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138c04f-8786-4121-8372-ff6050c81989 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.706834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.733837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f54e7-5c92-44c0-bbaf-865524ee85ba None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.767921 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c30213-397e-446d-9607-79fc64a1ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.768717 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c30213-397e-446d-9607-79fc64a1ba0c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.769001 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c30213-397e-446d-9607-79fc64a1ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.769278 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c30213-397e-446d-9607-79fc64a1ba0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.779306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c30213-397e-446d-9607-79fc64a1ba0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.780765 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c30213-397e-446d-9607-79fc64a1ba0c None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-32c30213-397e-446d-9607-79fc64a1ba0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:54.798006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:54.799204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:54.800193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:54.800193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:54.800193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:54.800193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:54.800193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 281/554] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:54.801397 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138c04f-8786-4121-8372-ff6050c81989 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.803242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c30213-397e-446d-9607-79fc64a1ba0c None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.834745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad6dee-5876-4af7-93fa-45bb5060e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.835465 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad6dee-5876-4af7-93fa-45bb5060e850 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.835754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad6dee-5876-4af7-93fa-45bb5060e850 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.836033 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad6dee-5876-4af7-93fa-45bb5060e850 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.846810 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad6dee-5876-4af7-93fa-45bb5060e850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-82ad6dee-5876-4af7-93fa-45bb5060e850 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:54.854475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:54.855525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:54.856639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 274/555] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:54.857613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad6dee-5876-4af7-93fa-45bb5060e850 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.894443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.906645 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c30213-397e-446d-9607-79fc64a1ba0c None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.929578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:54.944906 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9a691-fb47-4f04-8e0c-4f7dc9226f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:54.945576 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9a691-fb47-4f04-8e0c-4f7dc9226f53 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:54.945858 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9a691-fb47-4f04-8e0c-4f7dc9226f53 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:54.946141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9a691-fb47-4f04-8e0c-4f7dc9226f53 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:54.946897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9a691-fb47-4f04-8e0c-4f7dc9226f53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:54.947225 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9a691-fb47-4f04-8e0c-4f7dc9226f53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:54.948614 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca9a691-fb47-4f04-8e0c-4f7dc9226f53 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:54.959877 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 282/556] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:54.960737 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9a691-fb47-4f04-8e0c-4f7dc9226f53 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:54.965354 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad6dee-5876-4af7-93fa-45bb5060e850 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:54.999499 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411f85f-73fd-43dd-bfc7-b3982e1e78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.000146 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411f85f-73fd-43dd-bfc7-b3982e1e78f4 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.000425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411f85f-73fd-43dd-bfc7-b3982e1e78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.000699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411f85f-73fd-43dd-bfc7-b3982e1e78f4 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.001533 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411f85f-73fd-43dd-bfc7-b3982e1e78f4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:55.001840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411f85f-73fd-43dd-bfc7-b3982e1e78f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.003323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411f85f-73fd-43dd-bfc7-b3982e1e78f4 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.022047 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 275/557] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:55.022909 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411f85f-73fd-43dd-bfc7-b3982e1e78f4 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.062150 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca9a691-fb47-4f04-8e0c-4f7dc9226f53 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.095187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357b3cb-7718-4f3a-8f80-96025915967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.095832 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357b3cb-7718-4f3a-8f80-96025915967a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.096126 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357b3cb-7718-4f3a-8f80-96025915967a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.096406 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357b3cb-7718-4f3a-8f80-96025915967a None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.097129 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357b3cb-7718-4f3a-8f80-96025915967a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:55.097440 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357b3cb-7718-4f3a-8f80-96025915967a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.098879 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357b3cb-7718-4f3a-8f80-96025915967a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.111585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 283/558] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:55.112471 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357b3cb-7718-4f3a-8f80-96025915967a None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.121476 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411f85f-73fd-43dd-bfc7-b3982e1e78f4 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.124026 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.145869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.157129 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9e0fa-e208-468d-9884-ed3ae110aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.157870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9e0fa-e208-468d-9884-ed3ae110aad3 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.158245 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9e0fa-e208-468d-9884-ed3ae110aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.158555 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9e0fa-e208-468d-9884-ed3ae110aad3 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.159305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9e0fa-e208-468d-9884-ed3ae110aad3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:55.159612 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9e0fa-e208-468d-9884-ed3ae110aad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.160983 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a9e0fa-e208-468d-9884-ed3ae110aad3 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.174178 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 276/559] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:55.174178 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9e0fa-e208-468d-9884-ed3ae110aad3 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.216364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357b3cb-7718-4f3a-8f80-96025915967a None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.250039 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008151-ed2f-4961-be41-0ce49245f0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.250878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008151-ed2f-4961-be41-0ce49245f0e4 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.251165 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008151-ed2f-4961-be41-0ce49245f0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.251443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26008151-ed2f-4961-be41-0ce49245f0e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.258188 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26008151-ed2f-4961-be41-0ce49245f0e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.259697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26008151-ed2f-4961-be41-0ce49245f0e4 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.268611 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9e0fa-e208-468d-9884-ed3ae110aad3 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-26008151-ed2f-4961-be41-0ce49245f0e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:35:55.273862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:55.274947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 284/560] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:55.275852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008151-ed2f-4961-be41-0ce49245f0e4 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.304419 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d9ba7-2096-4485-a747-b10d51abbd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.305241 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d9ba7-2096-4485-a747-b10d51abbd2e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.305503 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d9ba7-2096-4485-a747-b10d51abbd2e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.305814 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d9ba7-2096-4485-a747-b10d51abbd2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.316926 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d9ba7-2096-4485-a747-b10d51abbd2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.318392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d9ba7-2096-4485-a747-b10d51abbd2e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-be3d9ba7-2096-4485-a747-b10d51abbd2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:55.336483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:55.337570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:55.338779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:55.338779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:55.338779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:55.338779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:55.342733 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 277/561] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:55.343786 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d9ba7-2096-4485-a747-b10d51abbd2e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.346081 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.378809 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26008151-ed2f-4961-be41-0ce49245f0e4 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.383969 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.411180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b09f60-5dd2-4730-8de3-7a95629a9817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.411977 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b09f60-5dd2-4730-8de3-7a95629a9817 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.412257 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b09f60-5dd2-4730-8de3-7a95629a9817 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.412533 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b09f60-5dd2-4730-8de3-7a95629a9817 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.420759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b09f60-5dd2-4730-8de3-7a95629a9817 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.422278 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b09f60-5dd2-4730-8de3-7a95629a9817 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-28b09f60-5dd2-4730-8de3-7a95629a9817 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:35:55.437260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:55.438373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 285/562] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:55.439767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b09f60-5dd2-4730-8de3-7a95629a9817 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.451201 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d9ba7-2096-4485-a747-b10d51abbd2e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.484730 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b52c7-5782-4f42-8bf0-5a2fd6b21e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.485603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b52c7-5782-4f42-8bf0-5a2fd6b21e90 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.485890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b52c7-5782-4f42-8bf0-5a2fd6b21e90 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.486165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b52c7-5782-4f42-8bf0-5a2fd6b21e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.496669 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b52c7-5782-4f42-8bf0-5a2fd6b21e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.498281 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b52c7-5782-4f42-8bf0-5a2fd6b21e90 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-5f3b52c7-5782-4f42-8bf0-5a2fd6b21e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:55.515401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:55.516433 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:55.517639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:55.517639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:55.517639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:55.517639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:55.517639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 278/563] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:55.517990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b52c7-5782-4f42-8bf0-5a2fd6b21e90 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.544318 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b09f60-5dd2-4730-8de3-7a95629a9817 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.572065 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.578670 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28a06-4a00-4b2a-9866-b9e45f218951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.579340 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28a06-4a00-4b2a-9866-b9e45f218951 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.579648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28a06-4a00-4b2a-9866-b9e45f218951 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.579923 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea28a06-4a00-4b2a-9866-b9e45f218951 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.580713 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28a06-4a00-4b2a-9866-b9e45f218951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:55.581021 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28a06-4a00-4b2a-9866-b9e45f218951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.582490 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea28a06-4a00-4b2a-9866-b9e45f218951 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.595692 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 286/564] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:55.596551 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28a06-4a00-4b2a-9866-b9e45f218951 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.614993 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.625286 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b52c7-5782-4f42-8bf0-5a2fd6b21e90 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.659815 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e9542-7a86-46be-b65a-536fc9f89255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.660481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e9542-7a86-46be-b65a-536fc9f89255 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.660767 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e9542-7a86-46be-b65a-536fc9f89255 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.661036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e9542-7a86-46be-b65a-536fc9f89255 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.661759 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e9542-7a86-46be-b65a-536fc9f89255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:55.662069 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e9542-7a86-46be-b65a-536fc9f89255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.663510 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e9542-7a86-46be-b65a-536fc9f89255 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.676452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 279/565] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:55.677266 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e9542-7a86-46be-b65a-536fc9f89255 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.696230 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea28a06-4a00-4b2a-9866-b9e45f218951 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.735279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb258ee2-15bc-43ef-bdc4-7bbaf823bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.735956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb258ee2-15bc-43ef-bdc4-7bbaf823bfab None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.736475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb258ee2-15bc-43ef-bdc4-7bbaf823bfab None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.736596 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb258ee2-15bc-43ef-bdc4-7bbaf823bfab None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.737462 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb258ee2-15bc-43ef-bdc4-7bbaf823bfab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:55.737777 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb258ee2-15bc-43ef-bdc4-7bbaf823bfab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.739281 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb258ee2-15bc-43ef-bdc4-7bbaf823bfab None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.756721 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 287/566] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:55.757313 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb258ee2-15bc-43ef-bdc4-7bbaf823bfab None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.781320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e9542-7a86-46be-b65a-536fc9f89255 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.804721 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.816767 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4538c-8c73-4c9e-9f0a-f77ec23bdfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.817437 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4538c-8c73-4c9e-9f0a-f77ec23bdfee None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.817722 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4538c-8c73-4c9e-9f0a-f77ec23bdfee None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.818009 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4538c-8c73-4c9e-9f0a-f77ec23bdfee None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.818765 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4538c-8c73-4c9e-9f0a-f77ec23bdfee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:55.819076 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4538c-8c73-4c9e-9f0a-f77ec23bdfee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.820459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4538c-8c73-4c9e-9f0a-f77ec23bdfee None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.831825 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 280/567] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:55.833593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4538c-8c73-4c9e-9f0a-f77ec23bdfee None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:55.850786 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:55.866714 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb258ee2-15bc-43ef-bdc4-7bbaf823bfab None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.909160 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60970a-7549-48b7-b1f2-169c407c1c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:55.910583 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60970a-7549-48b7-b1f2-169c407c1c83 None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:55.911099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60970a-7549-48b7-b1f2-169c407c1c83 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:55.911568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60970a-7549-48b7-b1f2-169c407c1c83 None admin] PATH_INFO: `/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/bf16c49c506a4f5c86e3538cd3ed12be/roles/04404f6921a84a09bb039aaea888fca8` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:55.930690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60970a-7549-48b7-b1f2-169c407c1c83 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad8cd680e7d47a7a966e6f82e56ec87, user_id=bf16c49c506a4f5c86e3538cd3ed12be, role_id=04404f6921a84a09bb039aaea888fca8)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:55.932365 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60970a-7549-48b7-b1f2-169c407c1c83 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:55.949778 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 288/568] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:55 2022] PUT /identity/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/bf16c49c506a4f5c86e3538cd3ed12be/roles/04404f6921a84a09bb039aaea888fca8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:55.949987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4538c-8c73-4c9e-9f0a-f77ec23bdfee None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:55.950709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60970a-7549-48b7-b1f2-169c407c1c83 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.003421 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53be88-ee93-4af1-981e-d45014b4b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.004284 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53be88-ee93-4af1-981e-d45014b4b603 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.004572 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53be88-ee93-4af1-981e-d45014b4b603 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.004851 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53be88-ee93-4af1-981e-d45014b4b603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.020431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53be88-ee93-4af1-981e-d45014b4b603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.023382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53be88-ee93-4af1-981e-d45014b4b603 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-0a53be88-ee93-4af1-981e-d45014b4b603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:35:56.046952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:56.048140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:56.049216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:35:56.049216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:35:56.049216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:35:56.049216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:35:56.049216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:35:56.049216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:35:56.049216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:56.049216 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:56.053151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 281/569] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:56.054146 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53be88-ee93-4af1-981e-d45014b4b603 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.085579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.090831 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60970a-7549-48b7-b1f2-169c407c1c83 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.131806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfe520-f5ae-4164-b88d-52452d68cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.132702 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfe520-f5ae-4164-b88d-52452d68cfce None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.133090 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfe520-f5ae-4164-b88d-52452d68cfce None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.133466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfe520-f5ae-4164-b88d-52452d68cfce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.148020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfe520-f5ae-4164-b88d-52452d68cfce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.149945 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfe520-f5ae-4164-b88d-52452d68cfce None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-efcfe520-f5ae-4164-b88d-52452d68cfce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:56.172690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:56.173613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:56.174568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:56.174568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:56.174568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:56.174568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:56.174568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 289/570] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:56.175126 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfe520-f5ae-4164-b88d-52452d68cfce None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.188587 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.214242 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53be88-ee93-4af1-981e-d45014b4b603 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.253718 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b174200-6110-4c74-948e-972d2a2c1acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.255149 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b174200-6110-4c74-948e-972d2a2c1acd None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.255435 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b174200-6110-4c74-948e-972d2a2c1acd None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.255714 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b174200-6110-4c74-948e-972d2a2c1acd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.264390 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b174200-6110-4c74-948e-972d2a2c1acd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.265853 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b174200-6110-4c74-948e-972d2a2c1acd None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-7b174200-6110-4c74-948e-972d2a2c1acd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:35:56.280754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:56.281959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 282/571] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:56.283062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b174200-6110-4c74-948e-972d2a2c1acd None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.292568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfe520-f5ae-4164-b88d-52452d68cfce None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.328771 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16363-852e-4778-b2fa-f4b1f77fa8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.329544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16363-852e-4778-b2fa-f4b1f77fa8fd None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.329825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16363-852e-4778-b2fa-f4b1f77fa8fd None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.330100 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec16363-852e-4778-b2fa-f4b1f77fa8fd None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.330910 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec16363-852e-4778-b2fa-f4b1f77fa8fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:56.331225 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec16363-852e-4778-b2fa-f4b1f77fa8fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.332907 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec16363-852e-4778-b2fa-f4b1f77fa8fd None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.351033 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 290/572] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:56.351033 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16363-852e-4778-b2fa-f4b1f77fa8fd None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.364382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.388094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b174200-6110-4c74-948e-972d2a2c1acd None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.417809 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.424471 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d22af5-6c58-4a2a-b43d-dac5937a7b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.425794 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d22af5-6c58-4a2a-b43d-dac5937a7b53 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.426219 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d22af5-6c58-4a2a-b43d-dac5937a7b53 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.426535 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d22af5-6c58-4a2a-b43d-dac5937a7b53 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.427263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d22af5-6c58-4a2a-b43d-dac5937a7b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:56.427572 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d22af5-6c58-4a2a-b43d-dac5937a7b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.428970 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d22af5-6c58-4a2a-b43d-dac5937a7b53 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.440382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 283/573] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:56.441243 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d22af5-6c58-4a2a-b43d-dac5937a7b53 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.465721 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec16363-852e-4778-b2fa-f4b1f77fa8fd None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.502122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185955-cc8f-4a3a-b542-6612dc818470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.503394 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185955-cc8f-4a3a-b542-6612dc818470 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.503894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185955-cc8f-4a3a-b542-6612dc818470 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.504236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185955-cc8f-4a3a-b542-6612dc818470 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.505137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185955-cc8f-4a3a-b542-6612dc818470 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:56.505555 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185955-cc8f-4a3a-b542-6612dc818470 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.507243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d185955-cc8f-4a3a-b542-6612dc818470 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.529339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 291/574] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:56.529339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185955-cc8f-4a3a-b542-6612dc818470 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.549703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d22af5-6c58-4a2a-b43d-dac5937a7b53 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.583900 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69377a90-ef0e-4d4d-8d77-b6a1bb373d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.584784 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377a90-ef0e-4d4d-8d77-b6a1bb373d26 None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.585070 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377a90-ef0e-4d4d-8d77-b6a1bb373d26 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.585344 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377a90-ef0e-4d4d-8d77-b6a1bb373d26 None admin] PATH_INFO: `/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/fc0920a9a54d4d839f1e2125431e9d19/roles/04404f6921a84a09bb039aaea888fca8` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.597224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.601699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69377a90-ef0e-4d4d-8d77-b6a1bb373d26 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad8cd680e7d47a7a966e6f82e56ec87, user_id=fc0920a9a54d4d839f1e2125431e9d19, role_id=04404f6921a84a09bb039aaea888fca8)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.603916 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69377a90-ef0e-4d4d-8d77-b6a1bb373d26 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.626468 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 284/575] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:56 2022] PUT /identity/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/fc0920a9a54d4d839f1e2125431e9d19/roles/04404f6921a84a09bb039aaea888fca8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:56.626468 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69377a90-ef0e-4d4d-8d77-b6a1bb373d26 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.653512 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185955-cc8f-4a3a-b542-6612dc818470 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.682643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.706211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dce34-fcc8-4912-91e3-f42d08068c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.707469 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dce34-fcc8-4912-91e3-f42d08068c22 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.707986 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dce34-fcc8-4912-91e3-f42d08068c22 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.708315 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dce34-fcc8-4912-91e3-f42d08068c22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.716843 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dce34-fcc8-4912-91e3-f42d08068c22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.718973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dce34-fcc8-4912-91e3-f42d08068c22 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e70dce34-fcc8-4912-91e3-f42d08068c22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:35:56.735837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:56.736943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:56.737841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:35:56.737841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:35:56.737841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:35:56.737841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:35:56.737841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:35:56.737841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:35:56.737841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:56.737841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:56.737841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 292/576] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:56.745964 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dce34-fcc8-4912-91e3-f42d08068c22 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.770452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69377a90-ef0e-4d4d-8d77-b6a1bb373d26 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.824428 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d63668-7351-430f-a984-72581fcc66a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.825536 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d63668-7351-430f-a984-72581fcc66a5 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.826630 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d63668-7351-430f-a984-72581fcc66a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.827051 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d63668-7351-430f-a984-72581fcc66a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.842944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d63668-7351-430f-a984-72581fcc66a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.844840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d63668-7351-430f-a984-72581fcc66a5 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.862995 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dce34-fcc8-4912-91e3-f42d08068c22 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-a3d63668-7351-430f-a984-72581fcc66a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:56.865107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:56.865981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:56.866889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:56.866889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:56.866889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:56.866889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:56.866889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 285/577] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:56.872961 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d63668-7351-430f-a984-72581fcc66a5 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.902709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.910747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d50f-5004-49a9-9d16-1c3276252661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:56.911600 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d50f-5004-49a9-9d16-1c3276252661 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:56.911973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d50f-5004-49a9-9d16-1c3276252661 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:56.913061 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48d50f-5004-49a9-9d16-1c3276252661 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:56.913870 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d50f-5004-49a9-9d16-1c3276252661 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:56.914189 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d50f-5004-49a9-9d16-1c3276252661 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:56.915695 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48d50f-5004-49a9-9d16-1c3276252661 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:56.932059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 293/578] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:56.937792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d50f-5004-49a9-9d16-1c3276252661 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:56.974479 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:56.984132 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d63668-7351-430f-a984-72581fcc66a5 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.022832 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b2ba0-946d-4483-be72-f1af1ad5f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.023976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b2ba0-946d-4483-be72-f1af1ad5f943 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.024596 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b2ba0-946d-4483-be72-f1af1ad5f943 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.024969 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b2ba0-946d-4483-be72-f1af1ad5f943 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.025793 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b2ba0-946d-4483-be72-f1af1ad5f943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:57.026195 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b2ba0-946d-4483-be72-f1af1ad5f943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.028660 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b2ba0-946d-4483-be72-f1af1ad5f943 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.047796 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 286/579] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:57.049042 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b2ba0-946d-4483-be72-f1af1ad5f943 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.051723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48d50f-5004-49a9-9d16-1c3276252661 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.093824 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5f71-f714-4109-9404-e71c9083cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.095283 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5f71-f714-4109-9404-e71c9083cef5 None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.095773 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5f71-f714-4109-9404-e71c9083cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.096065 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a5f71-f714-4109-9404-e71c9083cef5 None admin] PATH_INFO: `/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/7e58f00fa06e4a1ca16f5f8eba3dfb0e/roles/04404f6921a84a09bb039aaea888fca8` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.111296 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a5f71-f714-4109-9404-e71c9083cef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad8cd680e7d47a7a966e6f82e56ec87, user_id=7e58f00fa06e4a1ca16f5f8eba3dfb0e, role_id=04404f6921a84a09bb039aaea888fca8)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.112767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a5f71-f714-4109-9404-e71c9083cef5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.131769 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 294/580] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:56 2022] PUT /identity/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/7e58f00fa06e4a1ca16f5f8eba3dfb0e/roles/04404f6921a84a09bb039aaea888fca8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:57.166775 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b2ba0-946d-4483-be72-f1af1ad5f943 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.204778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15550a7-3192-4f2e-8f17-f1b6b1ca47eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.205659 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15550a7-3192-4f2e-8f17-f1b6b1ca47eb None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.205948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15550a7-3192-4f2e-8f17-f1b6b1ca47eb None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.206227 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15550a7-3192-4f2e-8f17-f1b6b1ca47eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.214588 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15550a7-3192-4f2e-8f17-f1b6b1ca47eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.216197 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15550a7-3192-4f2e-8f17-f1b6b1ca47eb None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-a15550a7-3192-4f2e-8f17-f1b6b1ca47eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:35:57.233498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:57.234581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:57.235689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:35:57.235689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:35:57.235689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:35:57.235689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:35:57.235689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:35:57.235689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:35:57.235689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:35:57.235689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:57.235689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 287/581] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:35:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:57.241181 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5f71-f714-4109-9404-e71c9083cef5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.285992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:57.356057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a5f71-f714-4109-9404-e71c9083cef5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.392264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be005a-ab9f-438d-9ff0-93dbc8e0d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.392986 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be005a-ab9f-438d-9ff0-93dbc8e0d500 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.393275 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be005a-ab9f-438d-9ff0-93dbc8e0d500 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.393557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be005a-ab9f-438d-9ff0-93dbc8e0d500 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.394344 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be005a-ab9f-438d-9ff0-93dbc8e0d500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:57.394739 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be005a-ab9f-438d-9ff0-93dbc8e0d500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.396182 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be005a-ab9f-438d-9ff0-93dbc8e0d500 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.408458 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 295/582] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:57.414105 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15550a7-3192-4f2e-8f17-f1b6b1ca47eb None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:57.429347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:57.516877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15550a7-3192-4f2e-8f17-f1b6b1ca47eb None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:57.551468 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed183d-fd14-45bc-a6fd-c4460649bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:57.552354 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed183d-fd14-45bc-a6fd-c4460649bfcd None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:57.552634 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed183d-fd14-45bc-a6fd-c4460649bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:57.552909 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed183d-fd14-45bc-a6fd-c4460649bfcd None admin] PATH_INFO: `/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/6ddd2eb988484d7ab0e64323fe4f4602/roles/04404f6921a84a09bb039aaea888fca8` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:57.567848 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed183d-fd14-45bc-a6fd-c4460649bfcd None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad8cd680e7d47a7a966e6f82e56ec87, user_id=6ddd2eb988484d7ab0e64323fe4f4602, role_id=04404f6921a84a09bb039aaea888fca8)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:57.569310 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed183d-fd14-45bc-a6fd-c4460649bfcd None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:57.583889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 288/583] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:35:57 2022] PUT /identity/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/6ddd2eb988484d7ab0e64323fe4f4602/roles/04404f6921a84a09bb039aaea888fca8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:35:58.345067 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29c99-b0ab-457e-a72f-19ca917f63b0 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.346135 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29c99-b0ab-457e-a72f-19ca917f63b0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.346664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d29c99-b0ab-457e-a72f-19ca917f63b0 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.348651 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 296/584] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:58.355064 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83845e4b-800d-476d-8e39-3d1074765a78 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.355986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83845e4b-800d-476d-8e39-3d1074765a78 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.356476 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83845e4b-800d-476d-8e39-3d1074765a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.375184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-83845e4b-800d-476d-8e39-3d1074765a78 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:58.376717 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-83845e4b-800d-476d-8e39-3d1074765a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:58.434563 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:58.447283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 289/585] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:58.475058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29c99-b0ab-457e-a72f-19ca917f63b0 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.574628 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:58.579971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d29c99-b0ab-457e-a72f-19ca917f63b0 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.620155 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b617d1d-da0f-481c-908e-3f9caa333bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.620866 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617d1d-da0f-481c-908e-3f9caa333bab None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.621151 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617d1d-da0f-481c-908e-3f9caa333bab None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.621431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617d1d-da0f-481c-908e-3f9caa333bab None admin] PATH_INFO: `/v3/roles/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.632229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b617d1d-da0f-481c-908e-3f9caa333bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-0b617d1d-da0f-481c-908e-3f9caa333bab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:58.639961 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:58.640867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:58.641683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 297/586] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:58.649047 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83845e4b-800d-476d-8e39-3d1074765a78 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.750051 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83845e4b-800d-476d-8e39-3d1074765a78 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.793947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8e2e-39e6-4503-a065-29dc9d520782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.794704 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8e2e-39e6-4503-a065-29dc9d520782 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.794990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8e2e-39e6-4503-a065-29dc9d520782 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.795269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d8e2e-39e6-4503-a065-29dc9d520782 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.796092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d8e2e-39e6-4503-a065-29dc9d520782 None admin] RBAC: Adding query filter params (name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:58.796398 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d8e2e-39e6-4503-a065-29dc9d520782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:58.797795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d8e2e-39e6-4503-a065-29dc9d520782 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:58.807164 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 290/587] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:58.815485 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b617d1d-da0f-481c-908e-3f9caa333bab None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:58.927553 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b617d1d-da0f-481c-908e-3f9caa333bab None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:58.962046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeeb1a1-943d-4ce6-8844-3eab7404ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:58.962902 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb1a1-943d-4ce6-8844-3eab7404ad2f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:58.963319 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb1a1-943d-4ce6-8844-3eab7404ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:58.963599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeeb1a1-943d-4ce6-8844-3eab7404ad2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:58.975280 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb1a1-943d-4ce6-8844-3eab7404ad2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:58.976762 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeeb1a1-943d-4ce6-8844-3eab7404ad2f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-9eeeb1a1-943d-4ce6-8844-3eab7404ad2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:58.994792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:58.995703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:58.996585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:58.996585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:58.996585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:58.996585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:58.996585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 298/588] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:59.002731 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8e2e-39e6-4503-a065-29dc9d520782 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.061842 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.091467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53290d4-a84d-4106-a8f5-154e06ab2382 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.091812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53290d4-a84d-4106-a8f5-154e06ab2382 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.092071 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53290d4-a84d-4106-a8f5-154e06ab2382 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.093944 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 299/589] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:35:59.098857 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e032-b5f5-4a21-afdc-72c2ccc7b6ae None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.099143 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e032-b5f5-4a21-afdc-72c2ccc7b6ae None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.099418 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508e032-b5f5-4a21-afdc-72c2ccc7b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.111942 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d8e2e-39e6-4503-a065-29dc9d520782 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.116966 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-2508e032-b5f5-4a21-afdc-72c2ccc7b6ae None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:59.118267 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-2508e032-b5f5-4a21-afdc-72c2ccc7b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:59.123558 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.148800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4305f-a44e-4b5d-aea6-15944f508bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.150160 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4305f-a44e-4b5d-aea6-15944f508bdd None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.150651 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4305f-a44e-4b5d-aea6-15944f508bdd None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.151117 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4305f-a44e-4b5d-aea6-15944f508bdd None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.152198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4305f-a44e-4b5d-aea6-15944f508bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:59.152766 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4305f-a44e-4b5d-aea6-15944f508bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.154359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4305f-a44e-4b5d-aea6-15944f508bdd None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.167510 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 291/590] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:59.173328 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4305f-a44e-4b5d-aea6-15944f508bdd None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.188937 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 300/591] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:59.212983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508e032-b5f5-4a21-afdc-72c2ccc7b6ae None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.280408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4305f-a44e-4b5d-aea6-15944f508bdd None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.301371 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.324361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508e032-b5f5-4a21-afdc-72c2ccc7b6ae None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.326513 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419863f7-6caf-44f8-b9f9-ee7e9d220f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.328303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419863f7-6caf-44f8-b9f9-ee7e9d220f24 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.328303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419863f7-6caf-44f8-b9f9-ee7e9d220f24 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.328303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419863f7-6caf-44f8-b9f9-ee7e9d220f24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.336879 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419863f7-6caf-44f8-b9f9-ee7e9d220f24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.338593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419863f7-6caf-44f8-b9f9-ee7e9d220f24 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-419863f7-6caf-44f8-b9f9-ee7e9d220f24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:35:59.355453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:59.356923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:35:59.358294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 292/592] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:35:59.362683 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419863f7-6caf-44f8-b9f9-ee7e9d220f24 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.370320 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52313-cf15-4654-ac63-3d5d170d844d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.371924 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52313-cf15-4654-ac63-3d5d170d844d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.372456 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52313-cf15-4654-ac63-3d5d170d844d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.373019 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae52313-cf15-4654-ac63-3d5d170d844d None admin] PATH_INFO: `/v3/roles/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.381945 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.385584 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae52313-cf15-4654-ac63-3d5d170d844d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-5ae52313-cf15-4654-ac63-3d5d170d844d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:35:59.394641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:59.395557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:35:59.396393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:59.403898 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 301/593] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:59.405203 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52313-cf15-4654-ac63-3d5d170d844d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.470549 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419863f7-6caf-44f8-b9f9-ee7e9d220f24 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.508020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692d19-c858-4ce6-894a-39a0e4025be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.508955 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692d19-c858-4ce6-894a-39a0e4025be0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.509067 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692d19-c858-4ce6-894a-39a0e4025be0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.509320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27692d19-c858-4ce6-894a-39a0e4025be0 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.510159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692d19-c858-4ce6-894a-39a0e4025be0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:59.510489 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692d19-c858-4ce6-894a-39a0e4025be0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.512050 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27692d19-c858-4ce6-894a-39a0e4025be0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.516359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae52313-cf15-4654-ac63-3d5d170d844d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.536299 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 293/594] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:35:59.537208 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692d19-c858-4ce6-894a-39a0e4025be0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.554404 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684bc8e-ea7d-4280-a91a-e012926109ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.555197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684bc8e-ea7d-4280-a91a-e012926109ca None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.555481 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684bc8e-ea7d-4280-a91a-e012926109ca None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.555756 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684bc8e-ea7d-4280-a91a-e012926109ca None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.556508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684bc8e-ea7d-4280-a91a-e012926109ca None admin] RBAC: Adding query filter params (name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:35:59.556817 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684bc8e-ea7d-4280-a91a-e012926109ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.558212 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684bc8e-ea7d-4280-a91a-e012926109ca None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.566658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 302/595] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:35:59.567972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062fe1b-a899-481f-a739-1df67addf74b None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.568273 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062fe1b-a899-481f-a739-1df67addf74b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.568538 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062fe1b-a899-481f-a739-1df67addf74b None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.569922 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 303/596] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:35:59.572850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062fe1b-a899-481f-a739-1df67addf74b None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.579820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.643147 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.661576 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27692d19-c858-4ce6-894a-39a0e4025be0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.682124 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062fe1b-a899-481f-a739-1df67addf74b None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:35:59.701096 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f9577-a85a-4857-817c-f26a0bf6cd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.701813 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f9577-a85a-4857-817c-f26a0bf6cd50 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.702092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f9577-a85a-4857-817c-f26a0bf6cd50 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.702369 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f9577-a85a-4857-817c-f26a0bf6cd50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.718164 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9daf607-06ff-4337-80cb-4aff6fe6444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:35:59.719005 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daf607-06ff-4337-80cb-4aff6fe6444b None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.719296 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daf607-06ff-4337-80cb-4aff6fe6444b None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.719579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9daf607-06ff-4337-80cb-4aff6fe6444b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.731455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9daf607-06ff-4337-80cb-4aff6fe6444b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.732910 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9daf607-06ff-4337-80cb-4aff6fe6444b None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-d9daf607-06ff-4337-80cb-4aff6fe6444b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:35:59.751684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:35:59.752663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:35:59.753544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:35:59.753544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:35:59.753544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:35:59.753544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:35:59.753544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 304/597] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:35:59.754733 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a93260-1ac1-4c33-9aa4-377ed04be33a None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:35:59.754992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a93260-1ac1-4c33-9aa4-377ed04be33a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:35:59.755304 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a93260-1ac1-4c33-9aa4-377ed04be33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:35:59.774859 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-33a93260-1ac1-4c33-9aa4-377ed04be33a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:35:59.776066 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-33a93260-1ac1-4c33-9aa4-377ed04be33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:35:59.787086 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f9577-a85a-4857-817c-f26a0bf6cd50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:35:59.788593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f9577-a85a-4857-817c-f26a0bf6cd50 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:35:59.822339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.862550 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 305/598] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:35:59.863701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a93260-1ac1-4c33-9aa4-377ed04be33a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.909395 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 294/599] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:35:59.910354 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f9577-a85a-4857-817c-f26a0bf6cd50 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:35:59.921491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:35:59.983366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a93260-1ac1-4c33-9aa4-377ed04be33a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.016811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750bc3e-5b96-4ed4-a6ab-b489a3f43ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.017193 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f9577-a85a-4857-817c-f26a0bf6cd50 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.017471 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750bc3e-5b96-4ed4-a6ab-b489a3f43ae9 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.017758 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750bc3e-5b96-4ed4-a6ab-b489a3f43ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.018038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750bc3e-5b96-4ed4-a6ab-b489a3f43ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.018799 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750bc3e-5b96-4ed4-a6ab-b489a3f43ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:00.019112 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750bc3e-5b96-4ed4-a6ab-b489a3f43ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.020511 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750bc3e-5b96-4ed4-a6ab-b489a3f43ae9 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.032122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 306/600] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:00.032910 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750bc3e-5b96-4ed4-a6ab-b489a3f43ae9 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.050979 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.057122 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38e1d-d42d-464b-bca9-5fb66802ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.058018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38e1d-d42d-464b-bca9-5fb66802ca19 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.058184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38e1d-d42d-464b-bca9-5fb66802ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.058493 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38e1d-d42d-464b-bca9-5fb66802ca19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.069140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38e1d-d42d-464b-bca9-5fb66802ca19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-5ec38e1d-d42d-464b-bca9-5fb66802ca19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:00.077159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:00.078182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:00.079181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 295/601] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:35:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:00.080004 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9c86-2837-46ec-b44f-67ed26ef7aa7 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.080004 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9c86-2837-46ec-b44f-67ed26ef7aa7 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.080004 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb9c86-2837-46ec-b44f-67ed26ef7aa7 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.081243 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 296/602] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:00.082004 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb9c86-2837-46ec-b44f-67ed26ef7aa7 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.139313 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750bc3e-5b96-4ed4-a6ab-b489a3f43ae9 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.141704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.174226 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c18d4-ab88-49a4-becd-7aba3ef681c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.175057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c18d4-ab88-49a4-becd-7aba3ef681c5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.175335 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c18d4-ab88-49a4-becd-7aba3ef681c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.175611 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c18d4-ab88-49a4-becd-7aba3ef681c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.185970 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c18d4-ab88-49a4-becd-7aba3ef681c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.187037 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb9c86-2837-46ec-b44f-67ed26ef7aa7 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.187457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c18d4-ab88-49a4-becd-7aba3ef681c5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-b49c18d4-ab88-49a4-becd-7aba3ef681c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:00.204034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:00.205094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:00.206190 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:00.206190 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:00.206190 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:00.206190 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:00.206190 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 307/603] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:00.206190 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c18d4-ab88-49a4-becd-7aba3ef681c5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.225353 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6394a8a-3fff-458f-8528-259ca7d05783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.226192 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394a8a-3fff-458f-8528-259ca7d05783 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.226508 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394a8a-3fff-458f-8528-259ca7d05783 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.226786 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6394a8a-3fff-458f-8528-259ca7d05783 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.235112 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394a8a-3fff-458f-8528-259ca7d05783 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.236515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6394a8a-3fff-458f-8528-259ca7d05783 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-d6394a8a-3fff-458f-8528-259ca7d05783 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:00.250869 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:00.251956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:00.253104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:00.254564 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 297/604] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:00.256064 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b2abd-b974-4442-ac56-787cc2245884 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.256359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b2abd-b974-4442-ac56-787cc2245884 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.256809 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b2abd-b974-4442-ac56-787cc2245884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.272873 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-b98b2abd-b974-4442-ac56-787cc2245884 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:00.274069 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-b98b2abd-b974-4442-ac56-787cc2245884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:00.304198 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c18d4-ab88-49a4-becd-7aba3ef681c5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.321653 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.338147 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84607deb-e113-4d01-8c2c-b5f5cd16f6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.338850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84607deb-e113-4d01-8c2c-b5f5cd16f6a1 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.339146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84607deb-e113-4d01-8c2c-b5f5cd16f6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.339428 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84607deb-e113-4d01-8c2c-b5f5cd16f6a1 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.340178 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84607deb-e113-4d01-8c2c-b5f5cd16f6a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:00.340488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84607deb-e113-4d01-8c2c-b5f5cd16f6a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.341933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84607deb-e113-4d01-8c2c-b5f5cd16f6a1 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.345769 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 298/605] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:00.346625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b2abd-b974-4442-ac56-787cc2245884 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.351159 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 308/606] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:00.352424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84607deb-e113-4d01-8c2c-b5f5cd16f6a1 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.373508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.459205 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84607deb-e113-4d01-8c2c-b5f5cd16f6a1 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.498470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d2e8c-65a0-4190-b1a6-6e9620a221c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.499061 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d2e8c-65a0-4190-b1a6-6e9620a221c7 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.499351 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d2e8c-65a0-4190-b1a6-6e9620a221c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.499635 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d2e8c-65a0-4190-b1a6-6e9620a221c7 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.500539 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d2e8c-65a0-4190-b1a6-6e9620a221c7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:00.500860 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d2e8c-65a0-4190-b1a6-6e9620a221c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.502328 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d2e8c-65a0-4190-b1a6-6e9620a221c7 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.521480 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 309/607] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:00.522403 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d2e8c-65a0-4190-b1a6-6e9620a221c7 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.580657 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b2abd-b974-4442-ac56-787cc2245884 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.598950 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.617603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dca39f-9b04-4cbe-a13b-46b2b72171ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.618270 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dca39f-9b04-4cbe-a13b-46b2b72171ed None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.618595 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dca39f-9b04-4cbe-a13b-46b2b72171ed None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.618876 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dca39f-9b04-4cbe-a13b-46b2b72171ed None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.619609 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dca39f-9b04-4cbe-a13b-46b2b72171ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:00.620122 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dca39f-9b04-4cbe-a13b-46b2b72171ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.621302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dca39f-9b04-4cbe-a13b-46b2b72171ed None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.622931 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d2e8c-65a0-4190-b1a6-6e9620a221c7 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.632754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 299/608] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:00.633561 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dca39f-9b04-4cbe-a13b-46b2b72171ed None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.659419 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68152b8-ffa5-4cc8-a308-d7ca129bc9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.660218 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68152b8-ffa5-4cc8-a308-d7ca129bc9b8 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.660503 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68152b8-ffa5-4cc8-a308-d7ca129bc9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.660779 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68152b8-ffa5-4cc8-a308-d7ca129bc9b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.671048 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68152b8-ffa5-4cc8-a308-d7ca129bc9b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.672511 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68152b8-ffa5-4cc8-a308-d7ca129bc9b8 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.677630 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-d68152b8-ffa5-4cc8-a308-d7ca129bc9b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:00.690826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:00.691887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:00.692798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:00.692798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:00.692798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:00.692798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:00.692798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 310/609] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:00.692798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68152b8-ffa5-4cc8-a308-d7ca129bc9b8 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.735934 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dca39f-9b04-4cbe-a13b-46b2b72171ed None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.768251 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aab14-9741-43b5-b59e-68cf74953624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.768970 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aab14-9741-43b5-b59e-68cf74953624 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.769267 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aab14-9741-43b5-b59e-68cf74953624 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.769544 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444aab14-9741-43b5-b59e-68cf74953624 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.779529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444aab14-9741-43b5-b59e-68cf74953624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-444aab14-9741-43b5-b59e-68cf74953624 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:00.787155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:00.788233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:00.789357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 300/610] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:00.791242 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aab14-9741-43b5-b59e-68cf74953624 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:00.794209 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68152b8-ffa5-4cc8-a308-d7ca129bc9b8 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.822453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.831180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc036-639d-4a94-9369-c6c0ba903e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.832227 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc036-639d-4a94-9369-c6c0ba903e7b None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.832517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc036-639d-4a94-9369-c6c0ba903e7b None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.832798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc036-639d-4a94-9369-c6c0ba903e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.891320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444aab14-9741-43b5-b59e-68cf74953624 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:00.892839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:00.899911 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cc036-639d-4a94-9369-c6c0ba903e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.901409 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cc036-639d-4a94-9369-c6c0ba903e7b None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.933145 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8d730-3e79-4599-8375-14e20f75573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:00.933948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8d730-3e79-4599-8375-14e20f75573c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:00.934210 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8d730-3e79-4599-8375-14e20f75573c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:00.934515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8d730-3e79-4599-8375-14e20f75573c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:00.941463 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8d730-3e79-4599-8375-14e20f75573c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:00.942968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8d730-3e79-4599-8375-14e20f75573c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-55f8d730-3e79-4599-8375-14e20f75573c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:00.956585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:00.957498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:00.958356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:00.958356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:00.958356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:00.958356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:00.958356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:00.958356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:00.958356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:00.958356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:00.958356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 301/611] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:00.958871 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8d730-3e79-4599-8375-14e20f75573c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.009348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 311/612] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:01.010193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc036-639d-4a94-9369-c6c0ba903e7b None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.036974 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.060846 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8d730-3e79-4599-8375-14e20f75573c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.094690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1e6b0-4856-40d0-b059-fc1aae4fcadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.095347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1e6b0-4856-40d0-b059-fc1aae4fcadb None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.095626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1e6b0-4856-40d0-b059-fc1aae4fcadb None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.095897 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1e6b0-4856-40d0-b059-fc1aae4fcadb None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.096626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1e6b0-4856-40d0-b059-fc1aae4fcadb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:01.096933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1e6b0-4856-40d0-b059-fc1aae4fcadb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.098609 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1e6b0-4856-40d0-b059-fc1aae4fcadb None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.110304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 302/613] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.111034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc036-639d-4a94-9369-c6c0ba903e7b None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.111138 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1e6b0-4856-40d0-b059-fc1aae4fcadb None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.136233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.148174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23fa1a-bcba-42c0-a93e-994390e4ef9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.148845 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23fa1a-bcba-42c0-a93e-994390e4ef9d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.149129 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23fa1a-bcba-42c0-a93e-994390e4ef9d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.149408 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23fa1a-bcba-42c0-a93e-994390e4ef9d None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.150154 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23fa1a-bcba-42c0-a93e-994390e4ef9d None admin] RBAC: Adding query filter params (name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:01.150491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23fa1a-bcba-42c0-a93e-994390e4ef9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.151890 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23fa1a-bcba-42c0-a93e-994390e4ef9d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.160007 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 312/614] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.160812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23fa1a-bcba-42c0-a93e-994390e4ef9d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.212952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1e6b0-4856-40d0-b059-fc1aae4fcadb None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.247255 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e837bc-005e-4aa8-bcfe-979dddb5cf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.247978 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e837bc-005e-4aa8-bcfe-979dddb5cf00 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.248267 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e837bc-005e-4aa8-bcfe-979dddb5cf00 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.248544 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e837bc-005e-4aa8-bcfe-979dddb5cf00 None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.249324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e837bc-005e-4aa8-bcfe-979dddb5cf00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:01.249635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e837bc-005e-4aa8-bcfe-979dddb5cf00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.249742 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.251114 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e837bc-005e-4aa8-bcfe-979dddb5cf00 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.259453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23fa1a-bcba-42c0-a93e-994390e4ef9d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.262543 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 303/615] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.263589 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e837bc-005e-4aa8-bcfe-979dddb5cf00 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.293206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ae3a-b97a-4c77-bfb4-ae03f4b4b4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.293925 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ae3a-b97a-4c77-bfb4-ae03f4b4b4c7 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.294210 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ae3a-b97a-4c77-bfb4-ae03f4b4b4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.294588 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ae3a-b97a-4c77-bfb4-ae03f4b4b4c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.305196 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ae3a-b97a-4c77-bfb4-ae03f4b4b4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.306710 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ae3a-b97a-4c77-bfb4-ae03f4b4b4c7 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-46d3ae3a-b97a-4c77-bfb4-ae03f4b4b4c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:01.324812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:01.325894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:01.326905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:01.326905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:01.326905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:01.326905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:01.327724 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 313/616] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:01.328496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ae3a-b97a-4c77-bfb4-ae03f4b4b4c7 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.346151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.365159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e837bc-005e-4aa8-bcfe-979dddb5cf00 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.398112 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660050f4-f550-4cc0-ad1e-8a1dbc948c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.398927 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660050f4-f550-4cc0-ad1e-8a1dbc948c5f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.399208 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660050f4-f550-4cc0-ad1e-8a1dbc948c5f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.399478 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660050f4-f550-4cc0-ad1e-8a1dbc948c5f None admin] PATH_INFO: `/v3/users/glance` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.406860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660050f4-f550-4cc0-ad1e-8a1dbc948c5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.408303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660050f4-f550-4cc0-ad1e-8a1dbc948c5f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-660050f4-f550-4cc0-ad1e-8a1dbc948c5f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:01.422304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:01.423474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 304/617] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:01.424754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660050f4-f550-4cc0-ad1e-8a1dbc948c5f None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.431895 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ae3a-b97a-4c77-bfb4-ae03f4b4b4c7 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.466046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08752c-b6d4-4589-9245-6605fc23b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.467416 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08752c-b6d4-4589-9245-6605fc23b4da None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.467700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08752c-b6d4-4589-9245-6605fc23b4da None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.467980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08752c-b6d4-4589-9245-6605fc23b4da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.478571 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08752c-b6d4-4589-9245-6605fc23b4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.480029 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08752c-b6d4-4589-9245-6605fc23b4da None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.481757 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-2f08752c-b6d4-4589-9245-6605fc23b4da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:01.497812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:01.498759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:01.504568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:01.504568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:01.504568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:01.504568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:01.504568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 314/618] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:01.504568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08752c-b6d4-4589-9245-6605fc23b4da None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.524057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660050f4-f550-4cc0-ad1e-8a1dbc948c5f None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.556412 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75059899-0fbd-4be0-853b-13afeb74975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.556991 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75059899-0fbd-4be0-853b-13afeb74975c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.557276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75059899-0fbd-4be0-853b-13afeb74975c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.557550 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75059899-0fbd-4be0-853b-13afeb74975c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.558376 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75059899-0fbd-4be0-853b-13afeb74975c None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=bf16c49c506a4f5c86e3538cd3ed12be) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:01.558741 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75059899-0fbd-4be0-853b-13afeb74975c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.560244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75059899-0fbd-4be0-853b-13afeb74975c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.566128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 305/619] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/role_assignments?user.id=bf16c49c506a4f5c86e3538cd3ed12be&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.568344 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75059899-0fbd-4be0-853b-13afeb74975c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.587425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.612682 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08752c-b6d4-4589-9245-6605fc23b4da None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.652360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319317c-fda6-4d48-b673-c325fb2b599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.653046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319317c-fda6-4d48-b673-c325fb2b599d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.653332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319317c-fda6-4d48-b673-c325fb2b599d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.653729 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319317c-fda6-4d48-b673-c325fb2b599d None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.654786 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319317c-fda6-4d48-b673-c325fb2b599d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:01.655104 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319317c-fda6-4d48-b673-c325fb2b599d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.656644 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319317c-fda6-4d48-b673-c325fb2b599d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.675687 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 315/620] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.676576 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319317c-fda6-4d48-b673-c325fb2b599d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.693064 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75059899-0fbd-4be0-853b-13afeb74975c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.728742 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cab1e4-f945-465c-be30-f44640cd3dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.729391 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cab1e4-f945-465c-be30-f44640cd3dc0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.729672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cab1e4-f945-465c-be30-f44640cd3dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.729950 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cab1e4-f945-465c-be30-f44640cd3dc0 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.730828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cab1e4-f945-465c-be30-f44640cd3dc0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:01.731135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cab1e4-f945-465c-be30-f44640cd3dc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.732683 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cab1e4-f945-465c-be30-f44640cd3dc0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.739824 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.753189 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 306/621] 10.222.0.26 () {56 vars in 1137 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.754329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cab1e4-f945-465c-be30-f44640cd3dc0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.796938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319317c-fda6-4d48-b673-c325fb2b599d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.838299 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41485ea9-bad8-4081-8458-2fa297f75cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.838824 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:01.839073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41485ea9-bad8-4081-8458-2fa297f75cbb None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.839365 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41485ea9-bad8-4081-8458-2fa297f75cbb None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.839639 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41485ea9-bad8-4081-8458-2fa297f75cbb None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.840964 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41485ea9-bad8-4081-8458-2fa297f75cbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:01.841368 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41485ea9-bad8-4081-8458-2fa297f75cbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.843373 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41485ea9-bad8-4081-8458-2fa297f75cbb None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.855007 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 316/622] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:01.855831 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41485ea9-bad8-4081-8458-2fa297f75cbb None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.882984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cab1e4-f945-465c-be30-f44640cd3dc0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.918557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac71dc-f28e-4cb2-93ea-e421f6e8a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:01.919418 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac71dc-f28e-4cb2-93ea-e421f6e8a63a None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:01.919707 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac71dc-f28e-4cb2-93ea-e421f6e8a63a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:01.919983 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac71dc-f28e-4cb2-93ea-e421f6e8a63a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:01.931130 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac71dc-f28e-4cb2-93ea-e421f6e8a63a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:01.932914 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac71dc-f28e-4cb2-93ea-e421f6e8a63a None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-ecac71dc-f28e-4cb2-93ea-e421f6e8a63a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:01.947626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:01.948753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 307/623] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:01.949963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac71dc-f28e-4cb2-93ea-e421f6e8a63a None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:01.969932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41485ea9-bad8-4081-8458-2fa297f75cbb None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:01.985728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.010125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcf9b5-c490-42fd-9429-092194a083cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.010820 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcf9b5-c490-42fd-9429-092194a083cc None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.011107 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcf9b5-c490-42fd-9429-092194a083cc None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.011389 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcf9b5-c490-42fd-9429-092194a083cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.054934 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac71dc-f28e-4cb2-93ea-e421f6e8a63a None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.081733 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcf9b5-c490-42fd-9429-092194a083cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.083584 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcf9b5-c490-42fd-9429-092194a083cc None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.084584 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.096854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17defe-14df-4e06-8f2e-7ae7fcde7ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.097584 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17defe-14df-4e06-8f2e-7ae7fcde7ce3 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.097865 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17defe-14df-4e06-8f2e-7ae7fcde7ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.098138 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17defe-14df-4e06-8f2e-7ae7fcde7ce3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.106464 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17defe-14df-4e06-8f2e-7ae7fcde7ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.107979 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17defe-14df-4e06-8f2e-7ae7fcde7ce3 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-bd17defe-14df-4e06-8f2e-7ae7fcde7ce3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:02.122886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:02.123862 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 308/624] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:02.127931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17defe-14df-4e06-8f2e-7ae7fcde7ce3 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.197177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 317/625] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:02.198347 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcf9b5-c490-42fd-9429-092194a083cc None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.215178 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.239453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17defe-14df-4e06-8f2e-7ae7fcde7ce3 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.274262 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f5857-9108-405f-a1d2-ab33515d9831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.274954 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f5857-9108-405f-a1d2-ab33515d9831 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.275235 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f5857-9108-405f-a1d2-ab33515d9831 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.275511 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f5857-9108-405f-a1d2-ab33515d9831 None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.276312 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f5857-9108-405f-a1d2-ab33515d9831 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:02.276619 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f5857-9108-405f-a1d2-ab33515d9831 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.278061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f5857-9108-405f-a1d2-ab33515d9831 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.291000 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 309/626] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:02.291615 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f5857-9108-405f-a1d2-ab33515d9831 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.305356 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcf9b5-c490-42fd-9429-092194a083cc None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.340644 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.341003 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80949c7-d670-4110-a311-0ad4675584dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.341963 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80949c7-d670-4110-a311-0ad4675584dd None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.342929 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80949c7-d670-4110-a311-0ad4675584dd None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.342929 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80949c7-d670-4110-a311-0ad4675584dd None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.343676 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80949c7-d670-4110-a311-0ad4675584dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:02.343982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80949c7-d670-4110-a311-0ad4675584dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.345423 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80949c7-d670-4110-a311-0ad4675584dd None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.368506 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 318/627] 10.222.0.26 () {56 vars in 1139 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:02.368506 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80949c7-d670-4110-a311-0ad4675584dd None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.408315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f5857-9108-405f-a1d2-ab33515d9831 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.439495 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.444846 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2addfd6-aa72-443e-999e-1f50fda51321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.445724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2addfd6-aa72-443e-999e-1f50fda51321 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.446010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2addfd6-aa72-443e-999e-1f50fda51321 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.446287 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2addfd6-aa72-443e-999e-1f50fda51321 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.457487 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2addfd6-aa72-443e-999e-1f50fda51321 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.458975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2addfd6-aa72-443e-999e-1f50fda51321 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.471021 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80949c7-d670-4110-a311-0ad4675584dd None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-e2addfd6-aa72-443e-999e-1f50fda51321 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:02.477144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:02.478030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:02.478930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:02.478930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:02.478930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:02.478930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:02.478930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 310/628] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:02.479242 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2addfd6-aa72-443e-999e-1f50fda51321 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.510698 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbd69d-587c-46f8-a03c-f3b18255f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.511361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbd69d-587c-46f8-a03c-f3b18255f0cf None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.511649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbd69d-587c-46f8-a03c-f3b18255f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.511930 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbd69d-587c-46f8-a03c-f3b18255f0cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.512758 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbd69d-587c-46f8-a03c-f3b18255f0cf None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=fc0920a9a54d4d839f1e2125431e9d19) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:02.513100 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbd69d-587c-46f8-a03c-f3b18255f0cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.514591 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bbd69d-587c-46f8-a03c-f3b18255f0cf None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.522557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 319/629] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/role_assignments?user.id=fc0920a9a54d4d839f1e2125431e9d19&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:02.522557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbd69d-587c-46f8-a03c-f3b18255f0cf None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.597553 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.606532 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2addfd6-aa72-443e-999e-1f50fda51321 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.639519 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbd69d-587c-46f8-a03c-f3b18255f0cf None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.648395 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4d000-7bf0-4dc3-ab0f-27cfce911ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.649447 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4d000-7bf0-4dc3-ab0f-27cfce911ecb None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.649937 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4d000-7bf0-4dc3-ab0f-27cfce911ecb None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.650445 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4d000-7bf0-4dc3-ab0f-27cfce911ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.677720 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e3e6f-3c47-4464-bb8a-c8d6b347720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.678544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3e6f-3c47-4464-bb8a-c8d6b347720d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.678822 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3e6f-3c47-4464-bb8a-c8d6b347720d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.679207 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e3e6f-3c47-4464-bb8a-c8d6b347720d None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.679879 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3e6f-3c47-4464-bb8a-c8d6b347720d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:02.680193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3e6f-3c47-4464-bb8a-c8d6b347720d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.681617 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e3e6f-3c47-4464-bb8a-c8d6b347720d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.684423 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.701774 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 320/630] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:02.704323 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e3e6f-3c47-4464-bb8a-c8d6b347720d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.739567 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4d000-7bf0-4dc3-ab0f-27cfce911ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.741082 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4d000-7bf0-4dc3-ab0f-27cfce911ecb None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.833074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e3e6f-3c47-4464-bb8a-c8d6b347720d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:02.869339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:02.879493 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c984-54e3-48c9-9b80-d44a10403f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:02.880010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 311/631] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:02.880307 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c984-54e3-48c9-9b80-d44a10403f45 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:02.880695 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c984-54e3-48c9-9b80-d44a10403f45 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:02.880980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5c984-54e3-48c9-9b80-d44a10403f45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:02.890526 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4d000-7bf0-4dc3-ab0f-27cfce911ecb None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.890691 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5c984-54e3-48c9-9b80-d44a10403f45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:02.891913 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5c984-54e3-48c9-9b80-d44a10403f45 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-1af5c984-54e3-48c9-9b80-d44a10403f45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:02.911068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:02.912191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:02.913144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:02.913144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:02.913144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:02.913144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:02.913144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:02.913144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:02.913144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:02.913144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:02.913144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 321/632] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:02.918192 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c984-54e3-48c9-9b80-d44a10403f45 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:02.979247 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:03.004406 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4d000-7bf0-4dc3-ab0f-27cfce911ecb None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:03.030505 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5c984-54e3-48c9-9b80-d44a10403f45 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:03.041068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a63010-a3d3-4dd5-a965-7447d347b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:03.042629 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a63010-a3d3-4dd5-a965-7447d347b7b2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.043045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a63010-a3d3-4dd5-a965-7447d347b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.043163 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a63010-a3d3-4dd5-a965-7447d347b7b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.054756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a63010-a3d3-4dd5-a965-7447d347b7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:03.056226 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a63010-a3d3-4dd5-a965-7447d347b7b2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:03.069511 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e80d5-ba08-4966-8eeb-bc2f23ff22c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:03.070386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e80d5-ba08-4966-8eeb-bc2f23ff22c2 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.070846 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e80d5-ba08-4966-8eeb-bc2f23ff22c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.071271 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e80d5-ba08-4966-8eeb-bc2f23ff22c2 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.072222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e80d5-ba08-4966-8eeb-bc2f23ff22c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:03.072678 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e80d5-ba08-4966-8eeb-bc2f23ff22c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-11a63010-a3d3-4dd5-a965-7447d347b7b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:03.074141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:03.075203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:03.076816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:03.076816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:03.076816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:03.076816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:03.077262 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e80d5-ba08-4966-8eeb-bc2f23ff22c2 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:03.080114 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 312/633] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:03.081445 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a63010-a3d3-4dd5-a965-7447d347b7b2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:03.097047 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 322/634] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:03.098177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e80d5-ba08-4966-8eeb-bc2f23ff22c2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:03.135706 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:03.191772 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a63010-a3d3-4dd5-a965-7447d347b7b2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:03.217467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e80d5-ba08-4966-8eeb-bc2f23ff22c2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:03.229271 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a061302-fbf1-412c-8f26-7e1148499bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:03.229938 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a061302-fbf1-412c-8f26-7e1148499bee None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.230346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a061302-fbf1-412c-8f26-7e1148499bee None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.230659 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a061302-fbf1-412c-8f26-7e1148499bee None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.231396 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a061302-fbf1-412c-8f26-7e1148499bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:03.231771 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a061302-fbf1-412c-8f26-7e1148499bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:03.233652 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a061302-fbf1-412c-8f26-7e1148499bee None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:03.239443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:03.252923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 313/635] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:03.254247 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a061302-fbf1-412c-8f26-7e1148499bee None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:03.261764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e987d5-437c-4c7f-8741-78b14efe990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:03.262677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e987d5-437c-4c7f-8741-78b14efe990e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.263145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e987d5-437c-4c7f-8741-78b14efe990e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.264389 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e987d5-437c-4c7f-8741-78b14efe990e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.265443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e987d5-437c-4c7f-8741-78b14efe990e None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=7e58f00fa06e4a1ca16f5f8eba3dfb0e) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:03.265933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e987d5-437c-4c7f-8741-78b14efe990e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:03.268616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e987d5-437c-4c7f-8741-78b14efe990e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:03.281464 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 323/636] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:03 2022] GET /identity/v3/role_assignments?user.id=7e58f00fa06e4a1ca16f5f8eba3dfb0e&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:03.373136 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a061302-fbf1-412c-8f26-7e1148499bee None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:03.383486 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:03.411655 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532102ea-7723-4cf5-9af2-325963a7bf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:03.412463 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532102ea-7723-4cf5-9af2-325963a7bf45 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.412749 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532102ea-7723-4cf5-9af2-325963a7bf45 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.413027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532102ea-7723-4cf5-9af2-325963a7bf45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.421273 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532102ea-7723-4cf5-9af2-325963a7bf45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:03.422788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532102ea-7723-4cf5-9af2-325963a7bf45 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-532102ea-7723-4cf5-9af2-325963a7bf45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:03.438600 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:03.439560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:03.440423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:03.440423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:03.440423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:03.440423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:03.440423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:03.440423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:03.440423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:03.440423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:03.444855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 314/637] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:03.446250 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e987d5-437c-4c7f-8741-78b14efe990e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:03.561977 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e987d5-437c-4c7f-8741-78b14efe990e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:03.599799 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966b121-f937-49e6-83c1-551d19fa26a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:03.600475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966b121-f937-49e6-83c1-551d19fa26a4 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.600762 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966b121-f937-49e6-83c1-551d19fa26a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.601039 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966b121-f937-49e6-83c1-551d19fa26a4 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.601832 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966b121-f937-49e6-83c1-551d19fa26a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:03.602146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966b121-f937-49e6-83c1-551d19fa26a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:03.603706 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966b121-f937-49e6-83c1-551d19fa26a4 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:03.617703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 324/638] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:03.623439 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532102ea-7723-4cf5-9af2-325963a7bf45 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:03.730429 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532102ea-7723-4cf5-9af2-325963a7bf45 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:03.766342 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca64e4d-474e-4fed-a219-4bf83d223df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:03.767035 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca64e4d-474e-4fed-a219-4bf83d223df9 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.767324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca64e4d-474e-4fed-a219-4bf83d223df9 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.767607 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca64e4d-474e-4fed-a219-4bf83d223df9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.768446 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca64e4d-474e-4fed-a219-4bf83d223df9 None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=6ddd2eb988484d7ab0e64323fe4f4602) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:03.768763 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca64e4d-474e-4fed-a219-4bf83d223df9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:03.770209 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca64e4d-474e-4fed-a219-4bf83d223df9 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:03.782565 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 315/639] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:03 2022] GET /identity/v3/role_assignments?user.id=6ddd2eb988484d7ab0e64323fe4f4602&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:03.952218 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418ddab-e8c4-452b-9a9d-cf65dd09d85e None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.952558 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418ddab-e8c4-452b-9a9d-cf65dd09d85e None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.952773 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418ddab-e8c4-452b-9a9d-cf65dd09d85e None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.954709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 325/640] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:03.960339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc2e8e-30c7-490a-89e5-8408b3925d0c None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:03.960635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc2e8e-30c7-490a-89e5-8408b3925d0c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:03.960904 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc2e8e-30c7-490a-89e5-8408b3925d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:03.979666 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-6edc2e8e-30c7-490a-89e5-8408b3925d0c None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:03.980931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-6edc2e8e-30c7-490a-89e5-8408b3925d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:04.008541 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:04.053185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 316/641] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:04.077820 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418ddab-e8c4-452b-9a9d-cf65dd09d85e None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:04.125411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:04.196791 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418ddab-e8c4-452b-9a9d-cf65dd09d85e None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:04.236246 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96b30-5665-4f23-8331-51d2cbcb7361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:04.236969 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96b30-5665-4f23-8331-51d2cbcb7361 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:04.237256 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96b30-5665-4f23-8331-51d2cbcb7361 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:04.237546 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef96b30-5665-4f23-8331-51d2cbcb7361 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:04.248542 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef96b30-5665-4f23-8331-51d2cbcb7361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-9ef96b30-5665-4f23-8331-51d2cbcb7361 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:04.256191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:04.257174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:04.258057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 326/642] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:04.263579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc2e8e-30c7-490a-89e5-8408b3925d0c None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:04.365540 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc2e8e-30c7-490a-89e5-8408b3925d0c None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:04.402500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c925-e34b-4ac1-8823-8afdbbfb4b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:04.403175 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c925-e34b-4ac1-8823-8afdbbfb4b6c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:04.403486 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c925-e34b-4ac1-8823-8afdbbfb4b6c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:04.403777 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1093c925-e34b-4ac1-8823-8afdbbfb4b6c None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:04.404528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c925-e34b-4ac1-8823-8afdbbfb4b6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:04.404945 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c925-e34b-4ac1-8823-8afdbbfb4b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:04.406354 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1093c925-e34b-4ac1-8823-8afdbbfb4b6c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:04.415553 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 317/643] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:04.421111 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96b30-5665-4f23-8331-51d2cbcb7361 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:04.521021 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:04.528389 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef96b30-5665-4f23-8331-51d2cbcb7361 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:04.566393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b48ab-90a0-4d35-8268-f5ff2514b0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:04.567254 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b48ab-90a0-4d35-8268-f5ff2514b0b5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:04.567544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b48ab-90a0-4d35-8268-f5ff2514b0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:04.567823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b48ab-90a0-4d35-8268-f5ff2514b0b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:04.580853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b48ab-90a0-4d35-8268-f5ff2514b0b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:04.582354 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b48ab-90a0-4d35-8268-f5ff2514b0b5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-3d7b48ab-90a0-4d35-8268-f5ff2514b0b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:04.601681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:04.602649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:04.603528 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:04.603528 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:04.603528 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:04.603528 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:04.603528 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 327/644] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:04.609886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c925-e34b-4ac1-8823-8afdbbfb4b6c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:04.637381 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:04.715373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1093c925-e34b-4ac1-8823-8afdbbfb4b6c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:04.750321 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb40419-ebb5-4dfc-af58-f49c0e7fb62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:04.751017 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb40419-ebb5-4dfc-af58-f49c0e7fb62e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:04.751303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb40419-ebb5-4dfc-af58-f49c0e7fb62e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:04.751585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb40419-ebb5-4dfc-af58-f49c0e7fb62e None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:04.752308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb40419-ebb5-4dfc-af58-f49c0e7fb62e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:04.752618 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb40419-ebb5-4dfc-af58-f49c0e7fb62e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:04.753999 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb40419-ebb5-4dfc-af58-f49c0e7fb62e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:04.766332 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 318/645] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:04.771757 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b48ab-90a0-4d35-8268-f5ff2514b0b5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:04.884447 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b48ab-90a0-4d35-8268-f5ff2514b0b5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:04.920351 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198801b-fa18-411c-a354-1968ee4c41c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:04.921165 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198801b-fa18-411c-a354-1968ee4c41c9 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:04.921453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198801b-fa18-411c-a354-1968ee4c41c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:04.921730 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198801b-fa18-411c-a354-1968ee4c41c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:04.934533 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198801b-fa18-411c-a354-1968ee4c41c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:04.934533 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198801b-fa18-411c-a354-1968ee4c41c9 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-b198801b-fa18-411c-a354-1968ee4c41c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:04.946446 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:04.947390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:04.948309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 328/646] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Jun 25 20:36:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:04.955508 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb40419-ebb5-4dfc-af58-f49c0e7fb62e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:05.045487 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:05.063204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb40419-ebb5-4dfc-af58-f49c0e7fb62e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:05.101558 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a05fe-1fd9-4014-aa22-1aa23c560c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:05.102237 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a05fe-1fd9-4014-aa22-1aa23c560c9e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.102550 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a05fe-1fd9-4014-aa22-1aa23c560c9e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.102830 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a05fe-1fd9-4014-aa22-1aa23c560c9e None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.103678 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a05fe-1fd9-4014-aa22-1aa23c560c9e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:05.103986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a05fe-1fd9-4014-aa22-1aa23c560c9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:05.105520 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5a05fe-1fd9-4014-aa22-1aa23c560c9e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:05.106860 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ae446-4e9f-44c2-89fd-4ee69a85f662 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.107150 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ae446-4e9f-44c2-89fd-4ee69a85f662 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.107455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ae446-4e9f-44c2-89fd-4ee69a85f662 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.109075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 329/647] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:05.114031 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375db1f-f70d-482e-80d1-f8fa81fcec39 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.114315 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375db1f-f70d-482e-80d1-f8fa81fcec39 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.114647 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375db1f-f70d-482e-80d1-f8fa81fcec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.125046 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 319/648] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Jun 25 20:36:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:05.131542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a05fe-1fd9-4014-aa22-1aa23c560c9e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:05.137233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-9375db1f-f70d-482e-80d1-f8fa81fcec39 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:05.139110 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-9375db1f-f70d-482e-80d1-f8fa81fcec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:05.151430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:05.220277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 330/649] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:05.241767 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a05fe-1fd9-4014-aa22-1aa23c560c9e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:05.244886 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375db1f-f70d-482e-80d1-f8fa81fcec39 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:05.282269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8746-eac2-4341-8edf-c2335325a214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:05.283549 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8746-eac2-4341-8edf-c2335325a214 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.284037 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8746-eac2-4341-8edf-c2335325a214 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.284613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8746-eac2-4341-8edf-c2335325a214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.297827 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:05.362034 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca8746-eac2-4341-8edf-c2335325a214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:05.363551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca8746-eac2-4341-8edf-c2335325a214 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:05.365321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375db1f-f70d-482e-80d1-f8fa81fcec39 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:05.409319 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1499e00-92ce-4a90-a8bd-c4349a5a3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:05.410567 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499e00-92ce-4a90-a8bd-c4349a5a3470 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.410997 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499e00-92ce-4a90-a8bd-c4349a5a3470 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.411804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1499e00-92ce-4a90-a8bd-c4349a5a3470 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.412867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1499e00-92ce-4a90-a8bd-c4349a5a3470 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:05.414595 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1499e00-92ce-4a90-a8bd-c4349a5a3470 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e1499e00-92ce-4a90-a8bd-c4349a5a3470 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:05.440222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:05.441421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:05.442465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:05.445025 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 331/650] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Jun 25 20:36:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:05.451013 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1499e00-92ce-4a90-a8bd-c4349a5a3470 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:05.461378 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:05.484918 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 320/651] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 25 20:36:05.491229 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8746-eac2-4341-8edf-c2335325a214 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:05.546039 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:05.571360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1499e00-92ce-4a90-a8bd-c4349a5a3470 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:05.607984 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d63f2f-3596-4610-b67d-2df0d813ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:05.608676 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d63f2f-3596-4610-b67d-2df0d813ff5c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.608946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d63f2f-3596-4610-b67d-2df0d813ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.609216 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d63f2f-3596-4610-b67d-2df0d813ff5c None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.609933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d63f2f-3596-4610-b67d-2df0d813ff5c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:05.610245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d63f2f-3596-4610-b67d-2df0d813ff5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:05.611981 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d63f2f-3596-4610-b67d-2df0d813ff5c None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:05.618389 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8746-eac2-4341-8edf-c2335325a214 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:05.621716 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 332/652] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:05.622912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d63f2f-3596-4610-b67d-2df0d813ff5c None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:05.659989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0bc24-101c-4a8b-8206-92db6be4278f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:05.660943 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0bc24-101c-4a8b-8206-92db6be4278f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.661327 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0bc24-101c-4a8b-8206-92db6be4278f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.661704 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0bc24-101c-4a8b-8206-92db6be4278f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.673272 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0bc24-101c-4a8b-8206-92db6be4278f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:05.675141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0bc24-101c-4a8b-8206-92db6be4278f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-63c0bc24-101c-4a8b-8206-92db6be4278f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:05.693856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:05.695026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:05.696115 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:05.696115 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:05.696115 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:05.696115 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:05.701856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 321/653] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:05.702874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0bc24-101c-4a8b-8206-92db6be4278f None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:05.708469 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:05.750451 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d63f2f-3596-4610-b67d-2df0d813ff5c None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:05.787159 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33f7cc-413a-40da-ba6c-f9351fe340e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:05.787834 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f7cc-413a-40da-ba6c-f9351fe340e5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.788121 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f7cc-413a-40da-ba6c-f9351fe340e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.788403 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33f7cc-413a-40da-ba6c-f9351fe340e5 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.789126 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33f7cc-413a-40da-ba6c-f9351fe340e5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:05.789430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33f7cc-413a-40da-ba6c-f9351fe340e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:05.790878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33f7cc-413a-40da-ba6c-f9351fe340e5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:05.797260 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 333/654] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:05.799871 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf75a8-5cd4-426f-a8fd-64d071f7ea7d None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.800157 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf75a8-5cd4-426f-a8fd-64d071f7ea7d None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.800431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf75a8-5cd4-426f-a8fd-64d071f7ea7d None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.806255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 334/655] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:05.807942 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90259-fb14-4775-a469-838e29378519 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.808230 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90259-fb14-4775-a469-838e29378519 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.808505 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a90259-fb14-4775-a469-838e29378519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.824863 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:05.829441 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-02a90259-fb14-4775-a469-838e29378519 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:05.831112 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-02a90259-fb14-4775-a469-838e29378519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:05.832093 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0bc24-101c-4a8b-8206-92db6be4278f None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:05.870886 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a444cd-11fe-4cf4-b6ca-e6bfff0ff2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:05.871564 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a444cd-11fe-4cf4-b6ca-e6bfff0ff2b5 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:05.871911 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a444cd-11fe-4cf4-b6ca-e6bfff0ff2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:05.872231 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a444cd-11fe-4cf4-b6ca-e6bfff0ff2b5 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:05.872969 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a444cd-11fe-4cf4-b6ca-e6bfff0ff2b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:05.873273 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a444cd-11fe-4cf4-b6ca-e6bfff0ff2b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:05.875613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a444cd-11fe-4cf4-b6ca-e6bfff0ff2b5 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:05.888148 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 322/656] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:05.893349 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a444cd-11fe-4cf4-b6ca-e6bfff0ff2b5 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:05.918855 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 335/657] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:36:05.938411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90259-fb14-4775-a469-838e29378519 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.003424 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a444cd-11fe-4cf4-b6ca-e6bfff0ff2b5 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.006815 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.046797 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484e87-037e-4173-b0c6-b8cd6fcdba40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.047746 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484e87-037e-4173-b0c6-b8cd6fcdba40 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.048031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484e87-037e-4173-b0c6-b8cd6fcdba40 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.048304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2484e87-037e-4173-b0c6-b8cd6fcdba40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.057707 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484e87-037e-4173-b0c6-b8cd6fcdba40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.059270 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2484e87-037e-4173-b0c6-b8cd6fcdba40 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.059673 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a90259-fb14-4775-a469-838e29378519 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-e2484e87-037e-4173-b0c6-b8cd6fcdba40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:06.076667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:06.077608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:06.078523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:06.078523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:06.078523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:06.078523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:06.078523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:06.078523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:06.078523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:06.078523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:06.078523 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 323/658] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:06.083806 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484e87-037e-4173-b0c6-b8cd6fcdba40 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.102514 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.116447 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f13eb-1f33-48fc-b0c3-bc28a0363656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.117271 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f13eb-1f33-48fc-b0c3-bc28a0363656 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.117557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f13eb-1f33-48fc-b0c3-bc28a0363656 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.117827 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f13eb-1f33-48fc-b0c3-bc28a0363656 None admin] PATH_INFO: `/v3/services/image` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.118519 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f13eb-1f33-48fc-b0c3-bc28a0363656 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.120059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f13eb-1f33-48fc-b0c3-bc28a0363656 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-729f13eb-1f33-48fc-b0c3-bc28a0363656 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:06.133298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:06.134348 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:06.135184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 336/659] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Jun 25 20:36:05 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:06.140353 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f13eb-1f33-48fc-b0c3-bc28a0363656 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.205939 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2484e87-037e-4173-b0c6-b8cd6fcdba40 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.245592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77932135-c55d-447e-a47c-fef277dccc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.246259 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932135-c55d-447e-a47c-fef277dccc8f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.246578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932135-c55d-447e-a47c-fef277dccc8f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.246858 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77932135-c55d-447e-a47c-fef277dccc8f None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.247912 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77932135-c55d-447e-a47c-fef277dccc8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:06.248226 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77932135-c55d-447e-a47c-fef277dccc8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.249788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77932135-c55d-447e-a47c-fef277dccc8f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.267876 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 324/660] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:06.269320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77932135-c55d-447e-a47c-fef277dccc8f None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.274873 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f13eb-1f33-48fc-b0c3-bc28a0363656 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.305133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.314579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6dab48-0e45-40ea-bf53-712ea35db310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.315249 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dab48-0e45-40ea-bf53-712ea35db310 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.315530 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dab48-0e45-40ea-bf53-712ea35db310 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.315952 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6dab48-0e45-40ea-bf53-712ea35db310 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.316658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dab48-0e45-40ea-bf53-712ea35db310 None admin] RBAC: Adding query filter params (name=image) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:06.316967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dab48-0e45-40ea-bf53-712ea35db310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.318582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6dab48-0e45-40ea-bf53-712ea35db310 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.327038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 337/661] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:06.327038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaec00-e032-4334-b88f-5889e68bd4ca None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.327038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaec00-e032-4334-b88f-5889e68bd4ca None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.327038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdaec00-e032-4334-b88f-5889e68bd4ca None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.327427 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 338/662] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:06.331650 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaec00-e032-4334-b88f-5889e68bd4ca None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.350663 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.377720 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77932135-c55d-447e-a47c-fef277dccc8f None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.413896 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c44e62-4493-4a4f-8494-8a28b7d5e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.414561 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c44e62-4493-4a4f-8494-8a28b7d5e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.414861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c44e62-4493-4a4f-8494-8a28b7d5e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.415138 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c44e62-4493-4a4f-8494-8a28b7d5e9e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.416372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c44e62-4493-4a4f-8494-8a28b7d5e9e4 None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=bf16c49c506a4f5c86e3538cd3ed12be) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:06.416690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c44e62-4493-4a4f-8494-8a28b7d5e9e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.418498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c44e62-4493-4a4f-8494-8a28b7d5e9e4 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.424558 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 325/663] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/role_assignments?user.id=bf16c49c506a4f5c86e3538cd3ed12be&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=8e22816a513845d88f4934c2164a142b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:06.426074 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80c1b4-5ba8-41af-928a-0585f5e67d7a None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.426360 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80c1b4-5ba8-41af-928a-0585f5e67d7a None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.426664 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80c1b4-5ba8-41af-928a-0585f5e67d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.446385 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-1f80c1b4-5ba8-41af-928a-0585f5e67d7a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:06.447666 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-1f80c1b4-5ba8-41af-928a-0585f5e67d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:06.458593 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdaec00-e032-4334-b88f-5889e68bd4ca None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.506063 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2b958-66b8-4d62-9d6c-d7bf69b79ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.507530 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2b958-66b8-4d62-9d6c-d7bf69b79ede None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.507998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2b958-66b8-4d62-9d6c-d7bf69b79ede None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.508855 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2b958-66b8-4d62-9d6c-d7bf69b79ede None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.510044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2b958-66b8-4d62-9d6c-d7bf69b79ede None admin] RBAC: Adding query filter params (type=image) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:06.510580 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2b958-66b8-4d62-9d6c-d7bf69b79ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.512436 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c2b958-66b8-4d62-9d6c-d7bf69b79ede None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.519796 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 339/664] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:06.542385 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 326/665] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:06.567410 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2b958-66b8-4d62-9d6c-d7bf69b79ede None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.642907 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.693893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2b958-66b8-4d62-9d6c-d7bf69b79ede None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.731384 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a8731-3113-41cb-85bb-fdd85aebbf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.732365 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a8731-3113-41cb-85bb-fdd85aebbf95 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.732546 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a8731-3113-41cb-85bb-fdd85aebbf95 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.732814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a8731-3113-41cb-85bb-fdd85aebbf95 None admin] PATH_INFO: `/v3/services/network` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.733486 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a8731-3113-41cb-85bb-fdd85aebbf95 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.734959 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568a8731-3113-41cb-85bb-fdd85aebbf95 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-568a8731-3113-41cb-85bb-fdd85aebbf95 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:06.747599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:06.749138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:06.749965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 340/666] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:06.757339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80c1b4-5ba8-41af-928a-0585f5e67d7a None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:06.827612 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:06.862788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80c1b4-5ba8-41af-928a-0585f5e67d7a None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:06.897784 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d5306-933d-4eae-ae00-091314317dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:06.898372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d5306-933d-4eae-ae00-091314317dbe None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:06.898689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d5306-933d-4eae-ae00-091314317dbe None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:06.898965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d5306-933d-4eae-ae00-091314317dbe None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:06.899684 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d5306-933d-4eae-ae00-091314317dbe None admin] RBAC: Adding query filter params (name=network) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:06.899991 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d5306-933d-4eae-ae00-091314317dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:06.901373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d5306-933d-4eae-ae00-091314317dbe None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:06.906739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 327/667] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:06.912137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a8731-3113-41cb-85bb-fdd85aebbf95 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:07.027883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568a8731-3113-41cb-85bb-fdd85aebbf95 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:07.062975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:07.067027 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f206e8-47b2-4ddc-83c2-3d010fd0bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:07.067707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f206e8-47b2-4ddc-83c2-3d010fd0bd7d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:07.068276 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f206e8-47b2-4ddc-83c2-3d010fd0bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:07.068553 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f206e8-47b2-4ddc-83c2-3d010fd0bd7d None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:07.069396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f206e8-47b2-4ddc-83c2-3d010fd0bd7d None admin] RBAC: Adding query filter params (type=network) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:07.069704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f206e8-47b2-4ddc-83c2-3d010fd0bd7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:07.071366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f206e8-47b2-4ddc-83c2-3d010fd0bd7d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:07.077010 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 341/668] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:08.170405 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b59f63-2aa2-4d77-bfb5-53078196a5ed None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:08.170948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b59f63-2aa2-4d77-bfb5-53078196a5ed None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:08.171024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b59f63-2aa2-4d77-bfb5-53078196a5ed None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:08.172566 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 328/669] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:08.177952 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414102-9945-49e2-9799-ae98e19c3ec3 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:08.178342 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414102-9945-49e2-9799-ae98e19c3ec3 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:08.178557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8414102-9945-49e2-9799-ae98e19c3ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:08.196270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-e8414102-9945-49e2-9799-ae98e19c3ec3 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:08.197463 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-e8414102-9945-49e2-9799-ae98e19c3ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:08.274648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 342/670] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:08.297986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b59f63-2aa2-4d77-bfb5-53078196a5ed None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:08.406045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b59f63-2aa2-4d77-bfb5-53078196a5ed None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:08.439126 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:08.441882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7866-d0c8-43b8-a0e9-e913c7c54b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:08.442589 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7866-d0c8-43b8-a0e9-e913c7c54b4b None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:08.442876 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7866-d0c8-43b8-a0e9-e913c7c54b4b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:08.443155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7866-d0c8-43b8-a0e9-e913c7c54b4b None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:08.443962 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7866-d0c8-43b8-a0e9-e913c7c54b4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:08.445347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7866-d0c8-43b8-a0e9-e913c7c54b4b None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:08.463472 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 329/671] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:08 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:08.842312 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e48bf0-d423-4f45-b05c-a2c1bcbcf334 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:08.843060 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e48bf0-d423-4f45-b05c-a2c1bcbcf334 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:08.843561 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e48bf0-d423-4f45-b05c-a2c1bcbcf334 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:08.845384 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 343/672] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:08.851051 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26489bcb-ec4c-42b3-9fc7-4dd36efd0296 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:08.851593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26489bcb-ec4c-42b3-9fc7-4dd36efd0296 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:08.852062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26489bcb-ec4c-42b3-9fc7-4dd36efd0296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:08.869450 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-26489bcb-ec4c-42b3-9fc7-4dd36efd0296 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:08.870992 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-26489bcb-ec4c-42b3-9fc7-4dd36efd0296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:08.941857 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4ca55-e562-4eca-b979-f32a872ff431 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:08.942497 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4ca55-e562-4eca-b979-f32a872ff431 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:08.943057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4ca55-e562-4eca-b979-f32a872ff431 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:08.944821 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 344/673] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:08.950060 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500b824-269a-4528-a0f5-9aebd87fb008 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:08.950657 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500b824-269a-4528-a0f5-9aebd87fb008 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:08.951129 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c500b824-269a-4528-a0f5-9aebd87fb008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:08.962450 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 330/674] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:08.974949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-c500b824-269a-4528-a0f5-9aebd87fb008 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:08.976355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-c500b824-269a-4528-a0f5-9aebd87fb008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:08.982502 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26489bcb-ec4c-42b3-9fc7-4dd36efd0296 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:09.048851 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 345/675] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 25 20:36:09.072154 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500b824-269a-4528-a0f5-9aebd87fb008 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:09.085176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26489bcb-ec4c-42b3-9fc7-4dd36efd0296 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:09.107952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:09.132066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b33d7-0b65-4bad-8f80-9170b7ad0acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:09.133138 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b33d7-0b65-4bad-8f80-9170b7ad0acc None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.133425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b33d7-0b65-4bad-8f80-9170b7ad0acc None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.133700 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b33d7-0b65-4bad-8f80-9170b7ad0acc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.135310 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:09.151885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b33d7-0b65-4bad-8f80-9170b7ad0acc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-fe4b33d7-0b65-4bad-8f80-9170b7ad0acc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:09.162174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:09.163185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:09.164285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 331/676] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:09.169219 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b33d7-0b65-4bad-8f80-9170b7ad0acc None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:09.209563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c500b824-269a-4528-a0f5-9aebd87fb008 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:09.256884 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d317cf-3adc-4e49-b815-85ba2f8d2206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:09.257695 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d317cf-3adc-4e49-b815-85ba2f8d2206 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.258044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d317cf-3adc-4e49-b815-85ba2f8d2206 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.258390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d317cf-3adc-4e49-b815-85ba2f8d2206 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.259573 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d317cf-3adc-4e49-b815-85ba2f8d2206 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:09.261813 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d317cf-3adc-4e49-b815-85ba2f8d2206 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:09.284045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b33d7-0b65-4bad-8f80-9170b7ad0acc None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:09.284708 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 346/677] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:09 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:36:09.337284 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770ddf9-f10b-4970-a88c-25ba2dcd3c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:09.338318 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770ddf9-f10b-4970-a88c-25ba2dcd3c5a None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.338764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770ddf9-f10b-4970-a88c-25ba2dcd3c5a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.339214 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770ddf9-f10b-4970-a88c-25ba2dcd3c5a None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.340171 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770ddf9-f10b-4970-a88c-25ba2dcd3c5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:09.340647 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770ddf9-f10b-4970-a88c-25ba2dcd3c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:09.342835 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770ddf9-f10b-4970-a88c-25ba2dcd3c5a None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:09.354260 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 332/678] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:09.359653 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d317cf-3adc-4e49-b815-85ba2f8d2206 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:09.477353 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d317cf-3adc-4e49-b815-85ba2f8d2206 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:09.479832 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:09.514213 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f5ec1-ec67-4b67-9156-2ff677ee13bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:09.515059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f5ec1-ec67-4b67-9156-2ff677ee13bf None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.515338 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f5ec1-ec67-4b67-9156-2ff677ee13bf None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.515611 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f5ec1-ec67-4b67-9156-2ff677ee13bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.521737 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8b4c-08c0-4177-81ed-70233444c182 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.522306 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8b4c-08c0-4177-81ed-70233444c182 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.522848 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8b4c-08c0-4177-81ed-70233444c182 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.525635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 333/679] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:09.530258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de22f0-b651-49eb-9783-709b5a338de0 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.530525 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f5ec1-ec67-4b67-9156-2ff677ee13bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:09.531012 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de22f0-b651-49eb-9783-709b5a338de0 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.531509 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de22f0-b651-49eb-9783-709b5a338de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.532836 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f5ec1-ec67-4b67-9156-2ff677ee13bf None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:09.549329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-a1de22f0-b651-49eb-9783-709b5a338de0 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:09.550885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-a1de22f0-b651-49eb-9783-709b5a338de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-891f5ec1-ec67-4b67-9156-2ff677ee13bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:09.558075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:09.559006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:09.559926 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:09.559926 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:09.559926 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:09.559926 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:09.560529 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 347/680] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:09.565763 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f5ec1-ec67-4b67-9156-2ff677ee13bf None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:09.584829 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:09.633136 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 334/681] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:09 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 25 20:36:09.657751 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de22f0-b651-49eb-9783-709b5a338de0 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:09.688122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f5ec1-ec67-4b67-9156-2ff677ee13bf None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:09.733173 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092795b0-4ceb-4b20-a6dc-43fcc3b09ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:09.733996 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092795b0-4ceb-4b20-a6dc-43fcc3b09ff8 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.734385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092795b0-4ceb-4b20-a6dc-43fcc3b09ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.734780 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092795b0-4ceb-4b20-a6dc-43fcc3b09ff8 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.736155 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092795b0-4ceb-4b20-a6dc-43fcc3b09ff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:09.736569 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092795b0-4ceb-4b20-a6dc-43fcc3b09ff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:09.738510 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092795b0-4ceb-4b20-a6dc-43fcc3b09ff8 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:09.753966 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 348/682] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:09.759967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092795b0-4ceb-4b20-a6dc-43fcc3b09ff8 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:09.769034 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de22f0-b651-49eb-9783-709b5a338de0 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:09.782911 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:09.814618 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c46759-b808-4b50-a6e2-4783328ace21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:09.815300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c46759-b808-4b50-a6e2-4783328ace21 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.815587 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c46759-b808-4b50-a6e2-4783328ace21 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.815864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c46759-b808-4b50-a6e2-4783328ace21 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.817187 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c46759-b808-4b50-a6e2-4783328ace21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:09.818774 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c46759-b808-4b50-a6e2-4783328ace21 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:09.842530 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 335/683] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:09 2022] POST /identity/v3/services => generated 240 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:36:09.883244 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092795b0-4ceb-4b20-a6dc-43fcc3b09ff8 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:09.949847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a86ed-5208-4754-8bcf-bf727abcb729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:09.950779 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a86ed-5208-4754-8bcf-bf727abcb729 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:09.951025 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a86ed-5208-4754-8bcf-bf727abcb729 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:09.951294 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a86ed-5208-4754-8bcf-bf727abcb729 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:09.960162 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a86ed-5208-4754-8bcf-bf727abcb729 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:09.961649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a86ed-5208-4754-8bcf-bf727abcb729 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-000a86ed-5208-4754-8bcf-bf727abcb729 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:09.977431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:09.978470 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:09.979438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 349/684] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Jun 25 20:36:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:09.986561 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c46759-b808-4b50-a6e2-4783328ace21 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.018800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.096312 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c46759-b808-4b50-a6e2-4783328ace21 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.133200 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a471209-fef4-4a8b-b129-2eca20085062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.134280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a471209-fef4-4a8b-b129-2eca20085062 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.134783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a471209-fef4-4a8b-b129-2eca20085062 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.135269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a471209-fef4-4a8b-b129-2eca20085062 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.136346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a471209-fef4-4a8b-b129-2eca20085062 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:10.136864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a471209-fef4-4a8b-b129-2eca20085062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:10.138711 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a471209-fef4-4a8b-b129-2eca20085062 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:10.160289 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 336/685] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Jun 25 20:36:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:10.165854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a86ed-5208-4754-8bcf-bf727abcb729 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.242453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.273456 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a86ed-5208-4754-8bcf-bf727abcb729 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.308420 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155991a-441e-49f8-a9a5-a0f743c64b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.309229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155991a-441e-49f8-a9a5-a0f743c64b53 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.309544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155991a-441e-49f8-a9a5-a0f743c64b53 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.309821 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155991a-441e-49f8-a9a5-a0f743c64b53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.320972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155991a-441e-49f8-a9a5-a0f743c64b53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:10.322457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155991a-441e-49f8-a9a5-a0f743c64b53 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-1155991a-441e-49f8-a9a5-a0f743c64b53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:10.339585 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:10.340491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:10.341595 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:10.341595 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:10.341595 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:10.341595 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:10.341595 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 350/686] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:10.348103 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a471209-fef4-4a8b-b129-2eca20085062 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.435344 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.452390 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a471209-fef4-4a8b-b129-2eca20085062 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.487808 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47b6c4-bc14-4c01-a694-2043591b11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.488470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47b6c4-bc14-4c01-a694-2043591b11f0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.488754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47b6c4-bc14-4c01-a694-2043591b11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.489030 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec47b6c4-bc14-4c01-a694-2043591b11f0 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.489755 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47b6c4-bc14-4c01-a694-2043591b11f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:10.490062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47b6c4-bc14-4c01-a694-2043591b11f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:10.491487 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec47b6c4-bc14-4c01-a694-2043591b11f0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:10.503686 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 337/687] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:10.509222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155991a-441e-49f8-a9a5-a0f743c64b53 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.621517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155991a-441e-49f8-a9a5-a0f743c64b53 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.645804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.657315 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc8fde-ecc3-4116-8465-81b7f47b2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.658122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc8fde-ecc3-4116-8465-81b7f47b2434 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.658408 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc8fde-ecc3-4116-8465-81b7f47b2434 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.658709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc8fde-ecc3-4116-8465-81b7f47b2434 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.665780 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc8fde-ecc3-4116-8465-81b7f47b2434 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:10.667437 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc8fde-ecc3-4116-8465-81b7f47b2434 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-c8dc8fde-ecc3-4116-8465-81b7f47b2434 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:10.682125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:10.684180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:10.686467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:10.686467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:10.686467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:10.686467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:10.686467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:10.686467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:10.686467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:10.686467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:10.686467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 351/688] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:10.691703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47b6c4-bc14-4c01-a694-2043591b11f0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.800343 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec47b6c4-bc14-4c01-a694-2043591b11f0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:10.807070 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dffb7e-f70f-4080-82b9-e12c5d6f2d18 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.807360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dffb7e-f70f-4080-82b9-e12c5d6f2d18 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.807640 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dffb7e-f70f-4080-82b9-e12c5d6f2d18 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.809254 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 352/689] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:10.815341 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b77a0-e9f6-4ca2-9b0e-b3f7b76ff6ed None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.815625 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b77a0-e9f6-4ca2-9b0e-b3f7b76ff6ed None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.815900 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b77a0-e9f6-4ca2-9b0e-b3f7b76ff6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.833492 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-374b77a0-e9f6-4ca2-9b0e-b3f7b76ff6ed None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:10.834502 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a4273-5575-4489-b40c-5bc9eda4e35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:10.834700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-374b77a0-e9f6-4ca2-9b0e-b3f7b76ff6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:10.835162 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a4273-5575-4489-b40c-5bc9eda4e35c None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:10.835551 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a4273-5575-4489-b40c-5bc9eda4e35c None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:10.835750 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a4273-5575-4489-b40c-5bc9eda4e35c None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:10.836554 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a4273-5575-4489-b40c-5bc9eda4e35c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:10.836800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a4273-5575-4489-b40c-5bc9eda4e35c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:10.838240 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56a4273-5575-4489-b40c-5bc9eda4e35c None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:10.851391 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 338/690] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:10.857503 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a4273-5575-4489-b40c-5bc9eda4e35c None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.862727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:10.938176 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 353/691] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:10 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:10.963949 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b77a0-e9f6-4ca2-9b0e-b3f7b76ff6ed None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:10.980050 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a4273-5575-4489-b40c-5bc9eda4e35c None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.025418 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047077ed-0246-4f50-b97a-5776b29b6f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.026866 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047077ed-0246-4f50-b97a-5776b29b6f11 None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.027548 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047077ed-0246-4f50-b97a-5776b29b6f11 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.028432 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047077ed-0246-4f50-b97a-5776b29b6f11 None admin] PATH_INFO: `/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/bf16c49c506a4f5c86e3538cd3ed12be/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.031732 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047077ed-0246-4f50-b97a-5776b29b6f11 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad8cd680e7d47a7a966e6f82e56ec87, user_id=bf16c49c506a4f5c86e3538cd3ed12be, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.033664 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047077ed-0246-4f50-b97a-5776b29b6f11 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.058671 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 339/692] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:36:10 2022] PUT /identity/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/bf16c49c506a4f5c86e3538cd3ed12be/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:36:11.083360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b77a0-e9f6-4ca2-9b0e-b3f7b76ff6ed None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.100610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.125189 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b86514-7755-4e08-b7c2-68de39beefea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.126095 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b86514-7755-4e08-b7c2-68de39beefea None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.126378 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b86514-7755-4e08-b7c2-68de39beefea None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.126750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b86514-7755-4e08-b7c2-68de39beefea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.127436 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b86514-7755-4e08-b7c2-68de39beefea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.128953 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b86514-7755-4e08-b7c2-68de39beefea None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-59b86514-7755-4e08-b7c2-68de39beefea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:11.143073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:11.144137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:11.144971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 354/693] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Jun 25 20:36:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:11.152683 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047077ed-0246-4f50-b97a-5776b29b6f11 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.229033 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.273558 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047077ed-0246-4f50-b97a-5776b29b6f11 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.310716 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80253ee-4638-44cb-a42e-b6271b2a2119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.311393 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80253ee-4638-44cb-a42e-b6271b2a2119 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.311685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80253ee-4638-44cb-a42e-b6271b2a2119 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.311970 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80253ee-4638-44cb-a42e-b6271b2a2119 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.312686 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80253ee-4638-44cb-a42e-b6271b2a2119 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:11.312998 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80253ee-4638-44cb-a42e-b6271b2a2119 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.314391 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80253ee-4638-44cb-a42e-b6271b2a2119 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.319674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 340/694] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:11.325407 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b86514-7755-4e08-b7c2-68de39beefea None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.436903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b86514-7755-4e08-b7c2-68de39beefea None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.471483 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55954fa1-a353-4e07-b914-3893ae013d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.472449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55954fa1-a353-4e07-b914-3893ae013d39 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.472901 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55954fa1-a353-4e07-b914-3893ae013d39 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.473372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55954fa1-a353-4e07-b914-3893ae013d39 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.474242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55954fa1-a353-4e07-b914-3893ae013d39 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:11.474736 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55954fa1-a353-4e07-b914-3893ae013d39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.476293 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55954fa1-a353-4e07-b914-3893ae013d39 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.481955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 355/695] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:11.488062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80253ee-4638-44cb-a42e-b6271b2a2119 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.595633 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80253ee-4638-44cb-a42e-b6271b2a2119 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.624527 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.632281 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aca9dd-93ea-4bcf-ab25-4afabff1c3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.633069 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aca9dd-93ea-4bcf-ab25-4afabff1c3a4 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.633418 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aca9dd-93ea-4bcf-ab25-4afabff1c3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.633757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aca9dd-93ea-4bcf-ab25-4afabff1c3a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.634670 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aca9dd-93ea-4bcf-ab25-4afabff1c3a4 None admin] RBAC: Adding query filter params (interface=public, service_id=f94e34c5eab24072bb83eeba4ff8c3b4, region_id=RegionOne) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:11.635051 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aca9dd-93ea-4bcf-ab25-4afabff1c3a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.636501 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aca9dd-93ea-4bcf-ab25-4afabff1c3a4 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.644785 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 341/696] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/endpoints?service_id=f94e34c5eab24072bb83eeba4ff8c3b4&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:11.650250 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55954fa1-a353-4e07-b914-3893ae013d39 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:11.697402 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:11.744164 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f868b-7d10-4199-b671-220af90dd023 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.744456 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f868b-7d10-4199-b671-220af90dd023 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.744798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f868b-7d10-4199-b671-220af90dd023 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.746400 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 342/697] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:11.751577 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02300d19-ce1a-476e-b7b1-3a2899f3da78 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.752065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02300d19-ce1a-476e-b7b1-3a2899f3da78 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.752450 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02300d19-ce1a-476e-b7b1-3a2899f3da78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.763029 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55954fa1-a353-4e07-b914-3893ae013d39 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:11.776256 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-02300d19-ce1a-476e-b7b1-3a2899f3da78 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:11.777877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-02300d19-ce1a-476e-b7b1-3a2899f3da78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:11.803020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9025-6ab8-40d5-9c9a-aeb06be68828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:11.804089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9025-6ab8-40d5-9c9a-aeb06be68828 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:11.804904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9025-6ab8-40d5-9c9a-aeb06be68828 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:11.805374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dd9025-6ab8-40d5-9c9a-aeb06be68828 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:11.806454 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd9025-6ab8-40d5-9c9a-aeb06be68828 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:11.808560 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dd9025-6ab8-40d5-9c9a-aeb06be68828 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:11.816085 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 356/698] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/services => generated 1002 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:36:11.858011 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 343/699] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:11 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:11.883100 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9025-6ab8-40d5-9c9a-aeb06be68828 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.016626 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dd9025-6ab8-40d5-9c9a-aeb06be68828 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.024054 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.052317 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bb9f7-d4fa-4147-b4ce-0826e3aad4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.053122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bb9f7-d4fa-4147-b4ce-0826e3aad4db None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.053410 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bb9f7-d4fa-4147-b4ce-0826e3aad4db None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.053689 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1bb9f7-d4fa-4147-b4ce-0826e3aad4db None admin] PATH_INFO: `/v3/services/image` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.054347 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bb9f7-d4fa-4147-b4ce-0826e3aad4db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.055775 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1bb9f7-d4fa-4147-b4ce-0826e3aad4db None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-fd1bb9f7-d4fa-4147-b4ce-0826e3aad4db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:12.068732 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:12.069770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:12.070654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 357/700] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Jun 25 20:36:11 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:12.078289 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02300d19-ce1a-476e-b7b1-3a2899f3da78 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.182142 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02300d19-ce1a-476e-b7b1-3a2899f3da78 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.207360 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.219891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da32bb-099f-4df9-b478-c935c1f1a4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.220612 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da32bb-099f-4df9-b478-c935c1f1a4ab None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.220893 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da32bb-099f-4df9-b478-c935c1f1a4ab None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.221164 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da32bb-099f-4df9-b478-c935c1f1a4ab None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.221931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da32bb-099f-4df9-b478-c935c1f1a4ab None admin] RBAC: Adding query filter params (name=image) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.222239 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da32bb-099f-4df9-b478-c935c1f1a4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.223653 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da32bb-099f-4df9-b478-c935c1f1a4ab None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.228744 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 344/701] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:12.234686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bb9f7-d4fa-4147-b4ce-0826e3aad4db None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.311611 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251777b-72fe-4b18-b319-90ca5ca4ad8d None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.311811 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251777b-72fe-4b18-b319-90ca5ca4ad8d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.312066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251777b-72fe-4b18-b319-90ca5ca4ad8d None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.313731 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 345/702] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:12.319388 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182098-7dbe-4eac-bb82-279b2ee3c20c None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.319678 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182098-7dbe-4eac-bb82-279b2ee3c20c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.319947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63182098-7dbe-4eac-bb82-279b2ee3c20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.336883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-63182098-7dbe-4eac-bb82-279b2ee3c20c None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:12.338249 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-63182098-7dbe-4eac-bb82-279b2ee3c20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:12.351195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1bb9f7-d4fa-4147-b4ce-0826e3aad4db None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.389151 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8368b-38df-4695-937c-677e04be0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.389825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8368b-38df-4695-937c-677e04be0c2e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.390504 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8368b-38df-4695-937c-677e04be0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.390612 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8368b-38df-4695-937c-677e04be0c2e None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.391248 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8368b-38df-4695-937c-677e04be0c2e None admin] RBAC: Adding query filter params (type=image) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.391560 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8368b-38df-4695-937c-677e04be0c2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.392962 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8368b-38df-4695-937c-677e04be0c2e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.398862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 358/703] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:12.407643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8368b-38df-4695-937c-677e04be0c2e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.415817 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 346/704] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:12.438722 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63182098-7dbe-4eac-bb82-279b2ee3c20c None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.452170 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.527145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8368b-38df-4695-937c-677e04be0c2e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.542283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63182098-7dbe-4eac-bb82-279b2ee3c20c None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.559106 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.566404 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539bee2-2c75-4e3a-badb-64828b08e677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.567476 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539bee2-2c75-4e3a-badb-64828b08e677 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.567973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539bee2-2c75-4e3a-badb-64828b08e677 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.568452 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539bee2-2c75-4e3a-badb-64828b08e677 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.569529 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539bee2-2c75-4e3a-badb-64828b08e677 None admin] RBAC: Adding query filter params (interface=public, service_id=6d5697116d0a4bc98ad868a9ab9fd84d, region_id=RegionOne) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.570125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539bee2-2c75-4e3a-badb-64828b08e677 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.571756 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539bee2-2c75-4e3a-badb-64828b08e677 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.577676 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240164a0-89b7-4bd2-a9eb-6bf869c34a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.578516 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240164a0-89b7-4bd2-a9eb-6bf869c34a4a None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.578863 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240164a0-89b7-4bd2-a9eb-6bf869c34a4a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.579062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240164a0-89b7-4bd2-a9eb-6bf869c34a4a None admin] PATH_INFO: `/v3/services/network` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.579722 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240164a0-89b7-4bd2-a9eb-6bf869c34a4a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.581086 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240164a0-89b7-4bd2-a9eb-6bf869c34a4a None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.581775 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 359/705] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/endpoints?service_id=6d5697116d0a4bc98ad868a9ab9fd84d&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:12.587030 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539bee2-2c75-4e3a-badb-64828b08e677 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-240164a0-89b7-4bd2-a9eb-6bf869c34a4a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:12.596141 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:12.597213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:12.598068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:12.602328 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 347/706] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:12.603201 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240164a0-89b7-4bd2-a9eb-6bf869c34a4a None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.695497 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:12.699969 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539bee2-2c75-4e3a-badb-64828b08e677 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.714926 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240164a0-89b7-4bd2-a9eb-6bf869c34a4a None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.736785 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c60dc-5c47-4b8e-8e8e-995212e1e295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.737854 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c60dc-5c47-4b8e-8e8e-995212e1e295 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.738380 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c60dc-5c47-4b8e-8e8e-995212e1e295 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.738922 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c60dc-5c47-4b8e-8e8e-995212e1e295 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.739923 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c60dc-5c47-4b8e-8e8e-995212e1e295 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.741652 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c60dc-5c47-4b8e-8e8e-995212e1e295 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.748182 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 360/707] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/services => generated 1002 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:36:12.759394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388167d3-e659-4380-9b65-1e08d6a02799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.760099 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388167d3-e659-4380-9b65-1e08d6a02799 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.760388 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388167d3-e659-4380-9b65-1e08d6a02799 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.760669 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388167d3-e659-4380-9b65-1e08d6a02799 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.761466 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388167d3-e659-4380-9b65-1e08d6a02799 None admin] RBAC: Adding query filter params (name=network) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.761783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388167d3-e659-4380-9b65-1e08d6a02799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.764077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388167d3-e659-4380-9b65-1e08d6a02799 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.770379 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 348/708] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:12.776567 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c60dc-5c47-4b8e-8e8e-995212e1e295 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:12.889349 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c60dc-5c47-4b8e-8e8e-995212e1e295 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:12.938233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e293f-545d-4daf-bdae-9ed8cb6eb69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:12.938996 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e293f-545d-4daf-bdae-9ed8cb6eb69a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:12.939278 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e293f-545d-4daf-bdae-9ed8cb6eb69a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:12.939555 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e293f-545d-4daf-bdae-9ed8cb6eb69a None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:12.940265 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e293f-545d-4daf-bdae-9ed8cb6eb69a None admin] RBAC: Adding query filter params (type=network) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:12.940571 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e293f-545d-4daf-bdae-9ed8cb6eb69a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:12.942087 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0e293f-545d-4daf-bdae-9ed8cb6eb69a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:12.948055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 361/709] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:12.953592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388167d3-e659-4380-9b65-1e08d6a02799 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.009996 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.068181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388167d3-e659-4380-9b65-1e08d6a02799 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.105385 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda7fd0a-3bbf-4fed-8869-e510b0c901d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.106046 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7fd0a-3bbf-4fed-8869-e510b0c901d8 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.106626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7fd0a-3bbf-4fed-8869-e510b0c901d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.106915 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda7fd0a-3bbf-4fed-8869-e510b0c901d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.107753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7fd0a-3bbf-4fed-8869-e510b0c901d8 None admin] RBAC: Adding query filter params (interface=public, service_id=4ca0c59ac31d4fd79df7b8f382a9d6c3, region_id=RegionOne) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:13.108066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7fd0a-3bbf-4fed-8869-e510b0c901d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.109521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda7fd0a-3bbf-4fed-8869-e510b0c901d8 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.115482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 349/710] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:12 2022] GET /identity/v3/endpoints?service_id=4ca0c59ac31d4fd79df7b8f382a9d6c3&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:13.120797 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e293f-545d-4daf-bdae-9ed8cb6eb69a None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.149820 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.228704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e293f-545d-4daf-bdae-9ed8cb6eb69a None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.267929 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da301a-e79b-48df-908c-ce2e3d213064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.268981 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da301a-e79b-48df-908c-ce2e3d213064 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.269490 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da301a-e79b-48df-908c-ce2e3d213064 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.269982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da301a-e79b-48df-908c-ce2e3d213064 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.270905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da301a-e79b-48df-908c-ce2e3d213064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.272506 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da301a-e79b-48df-908c-ce2e3d213064 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.278743 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 362/711] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/services => generated 1002 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:36:13.475534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f3a8-817e-471c-8002-2efb64494521 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.475914 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f3a8-817e-471c-8002-2efb64494521 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.476096 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3f3a8-817e-471c-8002-2efb64494521 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.477458 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 350/712] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:13.482855 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80c5c7-37c0-4add-9fd1-726ea1fcb8bd None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.483309 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80c5c7-37c0-4add-9fd1-726ea1fcb8bd None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.483405 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80c5c7-37c0-4add-9fd1-726ea1fcb8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.501341 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-cb80c5c7-37c0-4add-9fd1-726ea1fcb8bd None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:13.502616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-cb80c5c7-37c0-4add-9fd1-726ea1fcb8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:13.575421 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 363/713] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:13.600085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3f3a8-817e-471c-8002-2efb64494521 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.704074 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3f3a8-817e-471c-8002-2efb64494521 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.713466 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.739951 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b588-226c-4207-b073-3c27a2e36471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.740723 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b588-226c-4207-b073-3c27a2e36471 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.741008 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b588-226c-4207-b073-3c27a2e36471 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.741284 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b588-226c-4207-b073-3c27a2e36471 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.752581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82b588-226c-4207-b073-3c27a2e36471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-ba82b588-226c-4207-b073-3c27a2e36471 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:36:13.760233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:13.761151 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:13.762110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 351/714] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:13.767369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80c5c7-37c0-4add-9fd1-726ea1fcb8bd None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:13.795170 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:13.876476 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80c5c7-37c0-4add-9fd1-726ea1fcb8bd None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:13.911436 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6521-108c-4943-a5f3-6b25d2d13e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:13.912119 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6521-108c-4943-a5f3-6b25d2d13e9e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:13.912404 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6521-108c-4943-a5f3-6b25d2d13e9e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:13.912684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce6521-108c-4943-a5f3-6b25d2d13e9e None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:13.913433 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce6521-108c-4943-a5f3-6b25d2d13e9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:13.913744 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce6521-108c-4943-a5f3-6b25d2d13e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:13.915171 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce6521-108c-4943-a5f3-6b25d2d13e9e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:13.926304 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 364/715] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:13.934468 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b588-226c-4207-b073-3c27a2e36471 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.048123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b588-226c-4207-b073-3c27a2e36471 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.087388 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf5482-c960-488d-b258-02585c0e2ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.088186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf5482-c960-488d-b258-02585c0e2ee6 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.088466 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf5482-c960-488d-b258-02585c0e2ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.088747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf5482-c960-488d-b258-02585c0e2ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.099603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf5482-c960-488d-b258-02585c0e2ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.101087 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf5482-c960-488d-b258-02585c0e2ee6 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-60bf5482-c960-488d-b258-02585c0e2ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:14.119482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:14.120614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:14.121695 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:14.121695 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:14.121695 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:14.121695 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:14.121695 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 352/716] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:14.127770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6521-108c-4943-a5f3-6b25d2d13e9e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.213809 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.234090 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce6521-108c-4943-a5f3-6b25d2d13e9e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.268918 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a652b-f553-44ad-923d-b7eec8ee7b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.269927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a652b-f553-44ad-923d-b7eec8ee7b56 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.270453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a652b-f553-44ad-923d-b7eec8ee7b56 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.270931 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a652b-f553-44ad-923d-b7eec8ee7b56 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.271868 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a652b-f553-44ad-923d-b7eec8ee7b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:14.272374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a652b-f553-44ad-923d-b7eec8ee7b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.273952 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a652b-f553-44ad-923d-b7eec8ee7b56 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.288237 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 365/717] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:14.294025 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf5482-c960-488d-b258-02585c0e2ee6 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.325520 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.336830 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26c4f8-2b5d-4545-a451-573e0c05fea3 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.337126 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26c4f8-2b5d-4545-a451-573e0c05fea3 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.337412 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26c4f8-2b5d-4545-a451-573e0c05fea3 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.342520 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 366/718] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:36:14.344428 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190c048-de2f-47a1-b955-09186fc38479 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.344716 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190c048-de2f-47a1-b955-09186fc38479 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.344994 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190c048-de2f-47a1-b955-09186fc38479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.361900 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-e190c048-de2f-47a1-b955-09186fc38479 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:14.363159 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-e190c048-de2f-47a1-b955-09186fc38479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:14.412190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf5482-c960-488d-b258-02585c0e2ee6 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.438650 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 367/719] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:14.447004 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f37c2-4feb-4e44-ba85-f2af96f2b3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.447800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f37c2-4feb-4e44-ba85-f2af96f2b3fd None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.448083 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f37c2-4feb-4e44-ba85-f2af96f2b3fd None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.448357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f37c2-4feb-4e44-ba85-f2af96f2b3fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.455864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f37c2-4feb-4e44-ba85-f2af96f2b3fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.456398 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190c048-de2f-47a1-b955-09186fc38479 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.457324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f37c2-4feb-4e44-ba85-f2af96f2b3fd None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-286f37c2-4feb-4e44-ba85-f2af96f2b3fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:14.472625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:14.473601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:14.474573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 353/720] 10.222.0.26 () {56 vars in 1093 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:14.483584 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f37c2-4feb-4e44-ba85-f2af96f2b3fd None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.542061 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.573511 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190c048-de2f-47a1-b955-09186fc38479 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.599338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.617861 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b924e36-d82e-498a-869b-51efb38b8730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.619366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b924e36-d82e-498a-869b-51efb38b8730 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.620055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b924e36-d82e-498a-869b-51efb38b8730 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.620471 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b924e36-d82e-498a-869b-51efb38b8730 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.621567 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b924e36-d82e-498a-869b-51efb38b8730 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.623222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f37c2-4feb-4e44-ba85-f2af96f2b3fd None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.623991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b924e36-d82e-498a-869b-51efb38b8730 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-7b924e36-d82e-498a-869b-51efb38b8730 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:14.643306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:14.644526 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 25 20:36:14.645548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:14.652066 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 368/721] 10.222.0.26 () {56 vars in 1129 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:14.653559 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b924e36-d82e-498a-869b-51efb38b8730 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.671759 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce02fa-71d1-4271-931c-1fdc1e8083d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.672448 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce02fa-71d1-4271-931c-1fdc1e8083d0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.672793 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce02fa-71d1-4271-931c-1fdc1e8083d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.673077 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce02fa-71d1-4271-931c-1fdc1e8083d0 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.674078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce02fa-71d1-4271-931c-1fdc1e8083d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:14.674397 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce02fa-71d1-4271-931c-1fdc1e8083d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.675985 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce02fa-71d1-4271-931c-1fdc1e8083d0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.696505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 354/722] 10.222.0.26 () {56 vars in 1133 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:14.703458 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce02fa-71d1-4271-931c-1fdc1e8083d0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.774136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b924e36-d82e-498a-869b-51efb38b8730 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.820735 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb110f-efdf-40fb-a7de-84de1d9d0db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.821578 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb110f-efdf-40fb-a7de-84de1d9d0db6 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.821966 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb110f-efdf-40fb-a7de-84de1d9d0db6 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.822342 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb110f-efdf-40fb-a7de-84de1d9d0db6 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.823182 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb110f-efdf-40fb-a7de-84de1d9d0db6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:14.823702 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb110f-efdf-40fb-a7de-84de1d9d0db6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.825903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb110f-efdf-40fb-a7de-84de1d9d0db6 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:14.827876 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce02fa-71d1-4271-931c-1fdc1e8083d0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.828022 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.837788 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 369/723] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:14.839680 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb110f-efdf-40fb-a7de-84de1d9d0db6 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:14.872286 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afea7e-a4ee-4929-80fc-f4c4c1dbad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:14.873036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afea7e-a4ee-4929-80fc-f4c4c1dbad35 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:14.873264 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afea7e-a4ee-4929-80fc-f4c4c1dbad35 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:14.873543 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afea7e-a4ee-4929-80fc-f4c4c1dbad35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:14.883500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:14.960551 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb110f-efdf-40fb-a7de-84de1d9d0db6 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:14.980473 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afea7e-a4ee-4929-80fc-f4c4c1dbad35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:14.982521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afea7e-a4ee-4929-80fc-f4c4c1dbad35 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.006102 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541616-4c8b-4764-9a25-8471f33138e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.006803 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541616-4c8b-4764-9a25-8471f33138e9 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.007107 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541616-4c8b-4764-9a25-8471f33138e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.007649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541616-4c8b-4764-9a25-8471f33138e9 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.008372 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9541616-4c8b-4764-9a25-8471f33138e9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:15.008686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9541616-4c8b-4764-9a25-8471f33138e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.010086 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9541616-4c8b-4764-9a25-8471f33138e9 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.018509 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 370/724] 10.222.0.26 () {56 vars in 1124 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:15.022468 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541616-4c8b-4764-9a25-8471f33138e9 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.100643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.108092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 355/725] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:14 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:36:15.120200 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afea7e-a4ee-4929-80fc-f4c4c1dbad35 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.153485 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541616-4c8b-4764-9a25-8471f33138e9 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.163233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.198192 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34af527-d9ec-424f-ad67-1dec01f10db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.198882 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34af527-d9ec-424f-ad67-1dec01f10db8 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.199410 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34af527-d9ec-424f-ad67-1dec01f10db8 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.199688 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34af527-d9ec-424f-ad67-1dec01f10db8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.201374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34af527-d9ec-424f-ad67-1dec01f10db8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.202807 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34af527-d9ec-424f-ad67-1dec01f10db8 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.234186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 371/726] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:36:15.234186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7f1cc-0209-4890-935f-3abc10512278 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.234186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7f1cc-0209-4890-935f-3abc10512278 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.234186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7f1cc-0209-4890-935f-3abc10512278 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.234186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 372/727] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:15.238733 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789eba2-ed1d-469e-8bd7-466a89c4c0b4 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.239016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afea7e-a4ee-4929-80fc-f4c4c1dbad35 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.239116 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789eba2-ed1d-469e-8bd7-466a89c4c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.239290 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789eba2-ed1d-469e-8bd7-466a89c4c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.257729 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-f789eba2-ed1d-469e-8bd7-466a89c4c0b4 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:15.258991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-f789eba2-ed1d-469e-8bd7-466a89c4c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:15.292373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b969281-3da5-4a78-a4b2-bfb6a7f5dae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.293337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b969281-3da5-4a78-a4b2-bfb6a7f5dae2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.294046 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b969281-3da5-4a78-a4b2-bfb6a7f5dae2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.294327 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b969281-3da5-4a78-a4b2-bfb6a7f5dae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.308075 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b969281-3da5-4a78-a4b2-bfb6a7f5dae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.310052 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b969281-3da5-4a78-a4b2-bfb6a7f5dae2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-1b969281-3da5-4a78-a4b2-bfb6a7f5dae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:15.334340 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:15.335648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:15.336882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:15.336882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:15.336882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:15.336882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:15.340257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 356/728] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:15.341513 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b969281-3da5-4a78-a4b2-bfb6a7f5dae2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.342914 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 373/729] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:15 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:15.360304 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789eba2-ed1d-469e-8bd7-466a89c4c0b4 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.434355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.467801 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.492042 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b969281-3da5-4a78-a4b2-bfb6a7f5dae2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.505875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789eba2-ed1d-469e-8bd7-466a89c4c0b4 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.540197 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6bf72-88e2-48a0-a994-ce257443e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.541261 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6bf72-88e2-48a0-a994-ce257443e2eb None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.542027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6bf72-88e2-48a0-a994-ce257443e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.542410 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6bf72-88e2-48a0-a994-ce257443e2eb None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.543810 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6bf72-88e2-48a0-a994-ce257443e2eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:15.544244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6bf72-88e2-48a0-a994-ce257443e2eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.546688 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6bf72-88e2-48a0-a994-ce257443e2eb None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.550628 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8597ac-380a-49ab-89ec-34c8ca3d0fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.552028 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8597ac-380a-49ab-89ec-34c8ca3d0fec None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.552457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8597ac-380a-49ab-89ec-34c8ca3d0fec None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.552875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8597ac-380a-49ab-89ec-34c8ca3d0fec None admin] PATH_INFO: `/v3/services/image` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.553675 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8597ac-380a-49ab-89ec-34c8ca3d0fec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.555245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8597ac-380a-49ab-89ec-34c8ca3d0fec None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.561935 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 357/730] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:15.567396 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6bf72-88e2-48a0-a994-ce257443e2eb None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-2b8597ac-380a-49ab-89ec-34c8ca3d0fec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:15.569475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:15.570534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 25 20:36:15.571381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:15.572126 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 374/731] 10.222.0.26 () {56 vars in 1105 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/services/image => generated 86 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:15.578126 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8597ac-380a-49ab-89ec-34c8ca3d0fec None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.675877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6bf72-88e2-48a0-a994-ce257443e2eb None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.703298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8597ac-380a-49ab-89ec-34c8ca3d0fec None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.712874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb28cf5-b57e-4706-b95d-1d5c9fddf1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.713675 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb28cf5-b57e-4706-b95d-1d5c9fddf1de None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.714244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb28cf5-b57e-4706-b95d-1d5c9fddf1de None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.714692 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb28cf5-b57e-4706-b95d-1d5c9fddf1de None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.717691 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.724479 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb28cf5-b57e-4706-b95d-1d5c9fddf1de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.725938 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb28cf5-b57e-4706-b95d-1d5c9fddf1de None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-bdb28cf5-b57e-4706-b95d-1d5c9fddf1de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:15.740440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:15.741315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:15.742222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:15.742222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:15.742222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:15.742222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:15.742222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:15.742222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:15.742222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:15.742222 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:15.746154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 358/732] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:15.747890 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382816ae-be18-4388-8126-d6e8812f3066 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.748186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382816ae-be18-4388-8126-d6e8812f3066 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.748467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382816ae-be18-4388-8126-d6e8812f3066 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.749330 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbfa429-2877-4ede-8544-7e0ecfc41307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.749895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 359/733] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:15.750543 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382816ae-be18-4388-8126-d6e8812f3066 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.751575 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfa429-2877-4ede-8544-7e0ecfc41307 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.751872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfa429-2877-4ede-8544-7e0ecfc41307 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.752151 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbfa429-2877-4ede-8544-7e0ecfc41307 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.752868 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfa429-2877-4ede-8544-7e0ecfc41307 None admin] RBAC: Adding query filter params (name=image) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:15.753184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfa429-2877-4ede-8544-7e0ecfc41307 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.754932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbfa429-2877-4ede-8544-7e0ecfc41307 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.760830 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.761248 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 375/734] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:15.762856 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19f7e-b982-4769-9f4d-edd17a37474b None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.763195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19f7e-b982-4769-9f4d-edd17a37474b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.763516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d19f7e-b982-4769-9f4d-edd17a37474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.782217 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-45d19f7e-b982-4769-9f4d-edd17a37474b None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:15.783465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-45d19f7e-b982-4769-9f4d-edd17a37474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:15.859366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 376/735] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:15 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:15.860040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19f7e-b982-4769-9f4d-edd17a37474b None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.869385 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382816ae-be18-4388-8126-d6e8812f3066 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.905868 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7dbfd-fe42-4b53-a2d3-fb379f0ecf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:15.906557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7dbfd-fe42-4b53-a2d3-fb379f0ecf56 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:15.906844 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7dbfd-fe42-4b53-a2d3-fb379f0ecf56 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:15.907119 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7dbfd-fe42-4b53-a2d3-fb379f0ecf56 None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:15.907900 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7dbfd-fe42-4b53-a2d3-fb379f0ecf56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:15.908204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7dbfd-fe42-4b53-a2d3-fb379f0ecf56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:15.909734 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7dbfd-fe42-4b53-a2d3-fb379f0ecf56 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:15.926110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 360/736] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:15.926110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7dbfd-fe42-4b53-a2d3-fb379f0ecf56 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:15.986904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d19f7e-b982-4769-9f4d-edd17a37474b None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:15.991741 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:15.996363 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:16.022605 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5475b-5681-4288-882a-ce55dbf4907e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.023273 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5475b-5681-4288-882a-ce55dbf4907e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.023558 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5475b-5681-4288-882a-ce55dbf4907e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.023841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5475b-5681-4288-882a-ce55dbf4907e None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.024542 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5475b-5681-4288-882a-ce55dbf4907e None admin] RBAC: Adding query filter params (type=image) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:16.024861 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5475b-5681-4288-882a-ce55dbf4907e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.026231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5475b-5681-4288-882a-ce55dbf4907e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.029715 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7dbfd-fe42-4b53-a2d3-fb379f0ecf56 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.035806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 377/737] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:16.036563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5475b-5681-4288-882a-ce55dbf4907e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.066694 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f11ad9-3b5a-4bad-8f69-e0db9a8de25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.067554 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f11ad9-3b5a-4bad-8f69-e0db9a8de25a None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.067797 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f11ad9-3b5a-4bad-8f69-e0db9a8de25a None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.068076 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f11ad9-3b5a-4bad-8f69-e0db9a8de25a None admin] PATH_INFO: `/v3/services/network` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.068728 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f11ad9-3b5a-4bad-8f69-e0db9a8de25a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.070108 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f11ad9-3b5a-4bad-8f69-e0db9a8de25a None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-a4f11ad9-3b5a-4bad-8f69-e0db9a8de25a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:16.082066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:16.083123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:16.083989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 361/738] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:15 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:16.085096 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f11ad9-3b5a-4bad-8f69-e0db9a8de25a None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.145697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5475b-5681-4288-882a-ce55dbf4907e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.179433 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f2e87-d141-4e68-aded-2b29ff519a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.180085 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f2e87-d141-4e68-aded-2b29ff519a45 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.180376 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f2e87-d141-4e68-aded-2b29ff519a45 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.180696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f2e87-d141-4e68-aded-2b29ff519a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.181468 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f2e87-d141-4e68-aded-2b29ff519a45 None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=bf16c49c506a4f5c86e3538cd3ed12be) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:16.181783 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f2e87-d141-4e68-aded-2b29ff519a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.183269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f2e87-d141-4e68-aded-2b29ff519a45 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.189211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 378/739] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:36:16 2022] GET /identity/v3/role_assignments?user.id=bf16c49c506a4f5c86e3538cd3ed12be&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=8e22816a513845d88f4934c2164a142b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:16.189979 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f2e87-d141-4e68-aded-2b29ff519a45 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.204535 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f11ad9-3b5a-4bad-8f69-e0db9a8de25a None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.233603 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:16.251495 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:16.259930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da48d7-5e5e-4dec-8f38-88d7615dc600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.261370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da48d7-5e5e-4dec-8f38-88d7615dc600 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.261877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da48d7-5e5e-4dec-8f38-88d7615dc600 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.262939 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da48d7-5e5e-4dec-8f38-88d7615dc600 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.263887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da48d7-5e5e-4dec-8f38-88d7615dc600 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.266288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da48d7-5e5e-4dec-8f38-88d7615dc600 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.299315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 362/740] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:16.320631 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f2e87-d141-4e68-aded-2b29ff519a45 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.371997 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c47dfd-585a-4e46-9549-40eeee62af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.373102 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c47dfd-585a-4e46-9549-40eeee62af98 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.373623 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c47dfd-585a-4e46-9549-40eeee62af98 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.374046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c47dfd-585a-4e46-9549-40eeee62af98 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.375008 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c47dfd-585a-4e46-9549-40eeee62af98 None admin] RBAC: Adding query filter params (name=network) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:16.375483 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c47dfd-585a-4e46-9549-40eeee62af98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.377216 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c47dfd-585a-4e46-9549-40eeee62af98 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.383432 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 379/741] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:16.392078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da48d7-5e5e-4dec-8f38-88d7615dc600 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.516568 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da48d7-5e5e-4dec-8f38-88d7615dc600 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.553036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b5626-1e70-4e81-9956-50adce7b5586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.553713 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5626-1e70-4e81-9956-50adce7b5586 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.554001 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5626-1e70-4e81-9956-50adce7b5586 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.554277 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5626-1e70-4e81-9956-50adce7b5586 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.555028 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5626-1e70-4e81-9956-50adce7b5586 None admin] RBAC: Adding query filter params (type=network) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:16.555338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5626-1e70-4e81-9956-50adce7b5586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.556726 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5626-1e70-4e81-9956-50adce7b5586 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.563793 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 363/742] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:16.569080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c47dfd-585a-4e46-9549-40eeee62af98 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:16.668730 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:16.674511 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c47dfd-585a-4e46-9549-40eeee62af98 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:16.710388 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7727050-6c30-4bae-8fb9-fca8614c029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:16.711081 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727050-6c30-4bae-8fb9-fca8614c029a None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:16.711405 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727050-6c30-4bae-8fb9-fca8614c029a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:16.711688 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7727050-6c30-4bae-8fb9-fca8614c029a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:16.712456 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7727050-6c30-4bae-8fb9-fca8614c029a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:16.713905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7727050-6c30-4bae-8fb9-fca8614c029a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:16.749051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 380/743] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:17.709228 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c148-bf3e-4b44-b61a-b88fcf6a1fcb None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.709820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c148-bf3e-4b44-b61a-b88fcf6a1fcb None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.709820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33c148-bf3e-4b44-b61a-b88fcf6a1fcb None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.711412 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 364/744] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:17.717184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622aa3b-2566-4879-8e53-5eccf6f7e800 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.717608 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622aa3b-2566-4879-8e53-5eccf6f7e800 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.717812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622aa3b-2566-4879-8e53-5eccf6f7e800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.735685 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-e622aa3b-2566-4879-8e53-5eccf6f7e800 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:17.736868 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-e622aa3b-2566-4879-8e53-5eccf6f7e800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:17.810342 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 381/745] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:17 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:17.834595 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33c148-bf3e-4b44-b61a-b88fcf6a1fcb None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:17.887109 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:17.939679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33c148-bf3e-4b44-b61a-b88fcf6a1fcb None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:17.973540 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa079fe-ec77-4cd0-b85f-d8de87ff164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:17.974339 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa079fe-ec77-4cd0-b85f-d8de87ff164f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:17.974648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa079fe-ec77-4cd0-b85f-d8de87ff164f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:17.974928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa079fe-ec77-4cd0-b85f-d8de87ff164f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:17.975576 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa079fe-ec77-4cd0-b85f-d8de87ff164f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:17.976954 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa079fe-ec77-4cd0-b85f-d8de87ff164f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-bfa079fe-ec77-4cd0-b85f-d8de87ff164f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:17.988870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:17.989854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:17.990721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:17.992226 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 365/746] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:17.996019 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622aa3b-2566-4879-8e53-5eccf6f7e800 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.077098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.100729 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622aa3b-2566-4879-8e53-5eccf6f7e800 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.136741 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59320ec6-ee8e-4073-89a2-e777ac30c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.137467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320ec6-ee8e-4073-89a2-e777ac30c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.137802 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320ec6-ee8e-4073-89a2-e777ac30c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.138241 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59320ec6-ee8e-4073-89a2-e777ac30c0c5 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.138974 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320ec6-ee8e-4073-89a2-e777ac30c0c5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:18.139286 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320ec6-ee8e-4073-89a2-e777ac30c0c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.140678 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59320ec6-ee8e-4073-89a2-e777ac30c0c5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.145873 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 382/747] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:18.151318 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa079fe-ec77-4cd0-b85f-d8de87ff164f None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.259450 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa079fe-ec77-4cd0-b85f-d8de87ff164f None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.274643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.296442 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc26c23-4173-419c-bda0-55bd66122271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.297100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26c23-4173-419c-bda0-55bd66122271 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.297385 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26c23-4173-419c-bda0-55bd66122271 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.297658 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc26c23-4173-419c-bda0-55bd66122271 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.298356 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26c23-4173-419c-bda0-55bd66122271 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:18.298689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26c23-4173-419c-bda0-55bd66122271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.300062 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc26c23-4173-419c-bda0-55bd66122271 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.304771 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 366/748] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:18.616468 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5280d32-1ff2-463c-86fc-2e24215828c6 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.616822 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5280d32-1ff2-463c-86fc-2e24215828c6 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.616926 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5280d32-1ff2-463c-86fc-2e24215828c6 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.618326 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 383/749] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:18.623678 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fdb78-1970-4570-806d-81d9907806c5 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.624047 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fdb78-1970-4570-806d-81d9907806c5 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.624399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fdb78-1970-4570-806d-81d9907806c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.642071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-a24fdb78-1970-4570-806d-81d9907806c5 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:18.643311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-a24fdb78-1970-4570-806d-81d9907806c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:18.719796 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 367/750] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:18 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:18.723522 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7709945-df12-478b-834a-aae6d25caf0a None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.723950 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7709945-df12-478b-834a-aae6d25caf0a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.724454 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7709945-df12-478b-834a-aae6d25caf0a None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.726750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 384/751] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:18.732255 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cc209-3cb0-4c49-8824-43387ef4f448 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.732579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cc209-3cb0-4c49-8824-43387ef4f448 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.732792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cc209-3cb0-4c49-8824-43387ef4f448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.743802 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7709945-df12-478b-834a-aae6d25caf0a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.752728 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-2d3cc209-3cb0-4c49-8824-43387ef4f448 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:18.753958 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-2d3cc209-3cb0-4c49-8824-43387ef4f448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:18.827877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 368/752] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:18 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:18.851059 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cc209-3cb0-4c49-8824-43387ef4f448 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.859152 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7709945-df12-478b-834a-aae6d25caf0a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:18.895466 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.895706 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc1144-c21a-4452-90ba-9cfcd41e699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:18.896577 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc1144-c21a-4452-90ba-9cfcd41e699c None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:18.896863 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc1144-c21a-4452-90ba-9cfcd41e699c None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:18.897346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc1144-c21a-4452-90ba-9cfcd41e699c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:18.897786 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc1144-c21a-4452-90ba-9cfcd41e699c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:18.899268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc1144-c21a-4452-90ba-9cfcd41e699c None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-eabc1144-c21a-4452-90ba-9cfcd41e699c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:18.911893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:18.912838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:18.913696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 385/753] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:18.919736 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc1144-c21a-4452-90ba-9cfcd41e699c None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:18.933916 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:18.965586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cc209-3cb0-4c49-8824-43387ef4f448 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.001755 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a55256-67d7-4af9-83d3-43e6eaef538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.002405 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a55256-67d7-4af9-83d3-43e6eaef538e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.002716 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a55256-67d7-4af9-83d3-43e6eaef538e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.003384 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a55256-67d7-4af9-83d3-43e6eaef538e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.030770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc1144-c21a-4452-90ba-9cfcd41e699c None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.067481 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c967-465d-4003-b843-9d60d58ba2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.068465 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c967-465d-4003-b843-9d60d58ba2d0 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.068974 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c967-465d-4003-b843-9d60d58ba2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.069256 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c967-465d-4003-b843-9d60d58ba2d0 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.069969 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35c967-465d-4003-b843-9d60d58ba2d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:19.070284 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35c967-465d-4003-b843-9d60d58ba2d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.071712 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35c967-465d-4003-b843-9d60d58ba2d0 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.076879 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 386/754] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:19.081284 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a55256-67d7-4af9-83d3-43e6eaef538e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.082628 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c967-465d-4003-b843-9d60d58ba2d0 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.082741 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a55256-67d7-4af9-83d3-43e6eaef538e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.124878 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.161108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.193483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 369/755] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:36:18 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 25 20:36:19.196436 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c967-465d-4003-b843-9d60d58ba2d0 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.199152 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a55256-67d7-4af9-83d3-43e6eaef538e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.235903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d17a5-2a71-41f3-a439-7ac25a80a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.236593 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d17a5-2a71-41f3-a439-7ac25a80a662 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.236878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d17a5-2a71-41f3-a439-7ac25a80a662 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.237152 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d17a5-2a71-41f3-a439-7ac25a80a662 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.238256 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d17a5-2a71-41f3-a439-7ac25a80a662 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:19.238609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d17a5-2a71-41f3-a439-7ac25a80a662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.240344 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d17a5-2a71-41f3-a439-7ac25a80a662 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.245870 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 387/756] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:19.304393 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a55256-67d7-4af9-83d3-43e6eaef538e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.345101 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb34b50-8161-4268-96e4-c3a21ca059c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.345920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34b50-8161-4268-96e4-c3a21ca059c6 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.346204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34b50-8161-4268-96e4-c3a21ca059c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.346517 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb34b50-8161-4268-96e4-c3a21ca059c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.354820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.359260 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34b50-8161-4268-96e4-c3a21ca059c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.360978 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb34b50-8161-4268-96e4-c3a21ca059c6 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-deb34b50-8161-4268-96e4-c3a21ca059c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:36:19.380690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:19.381674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:19.382571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:36:19.382571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:36:19.382571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:36:19.382571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:19.382571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 370/757] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:19.391818 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d17a5-2a71-41f3-a439-7ac25a80a662 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:19.501494 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d17a5-2a71-41f3-a439-7ac25a80a662 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:19.535355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebfca4-9694-4bf6-b915-fd581e50fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:19.536021 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebfca4-9694-4bf6-b915-fd581e50fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:19.536308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebfca4-9694-4bf6-b915-fd581e50fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:19.536586 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebfca4-9694-4bf6-b915-fd581e50fdf7 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:19.537315 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebfca4-9694-4bf6-b915-fd581e50fdf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:19.537628 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebfca4-9694-4bf6-b915-fd581e50fdf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:19.539081 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebfca4-9694-4bf6-b915-fd581e50fdf7 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:19.540574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:19.552024 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 388/758] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:20.611318 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba678b6-7761-48ac-a76d-5cc63acac04c None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.611891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba678b6-7761-48ac-a76d-5cc63acac04c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.611891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba678b6-7761-48ac-a76d-5cc63acac04c None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.613219 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 371/759] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:20.618864 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44cdb-b91b-4292-b132-c7e99d667407 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.619253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44cdb-b91b-4292-b132-c7e99d667407 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.619420 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44cdb-b91b-4292-b132-c7e99d667407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.636908 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-98a44cdb-b91b-4292-b132-c7e99d667407 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:20.638222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-98a44cdb-b91b-4292-b132-c7e99d667407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:20.705898 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 389/760] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:20 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:20.730130 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba678b6-7761-48ac-a76d-5cc63acac04c None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:20.838360 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba678b6-7761-48ac-a76d-5cc63acac04c None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:20.874075 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94faa2e4-90cf-4fc2-a023-fdfbc2ec6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:20.874683 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faa2e4-90cf-4fc2-a023-fdfbc2ec6f08 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:20.875034 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faa2e4-90cf-4fc2-a023-fdfbc2ec6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:20.875239 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94faa2e4-90cf-4fc2-a023-fdfbc2ec6f08 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:20.875968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94faa2e4-90cf-4fc2-a023-fdfbc2ec6f08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:20.877350 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94faa2e4-90cf-4fc2-a023-fdfbc2ec6f08 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:20.891821 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 372/761] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:20 2022] POST /identity/v3/services => generated 251 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:21.554337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b547-0218-494d-b5e2-83cea6a30805 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.554621 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b547-0218-494d-b5e2-83cea6a30805 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.554903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b547-0218-494d-b5e2-83cea6a30805 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.556288 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 390/762] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:21.561792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200c91e-0759-462f-a3fa-03e4c4588996 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.562156 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200c91e-0759-462f-a3fa-03e4c4588996 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.562555 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200c91e-0759-462f-a3fa-03e4c4588996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.580568 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-0200c91e-0759-462f-a3fa-03e4c4588996 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:21.581753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-0200c91e-0759-462f-a3fa-03e4c4588996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:21.631493 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:21.660494 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 373/763] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:21 2022] POST /identity/v3/auth/tokens => generated 1497 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:21.685014 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b547-0218-494d-b5e2-83cea6a30805 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:21.794382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b547-0218-494d-b5e2-83cea6a30805 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:21.818135 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:21.830427 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734d225-01ea-4b90-90f2-8a18e2d471c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:21.831120 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734d225-01ea-4b90-90f2-8a18e2d471c7 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:21.831400 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734d225-01ea-4b90-90f2-8a18e2d471c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:21.831678 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734d225-01ea-4b90-90f2-8a18e2d471c7 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:21.832400 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734d225-01ea-4b90-90f2-8a18e2d471c7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:21.833796 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734d225-01ea-4b90-90f2-8a18e2d471c7 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:21.848345 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 391/764] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:21 2022] POST /identity/v3/services => generated 269 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:23.178952 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086d22e-645e-43c2-b909-c7a8fddf8593 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.179473 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086d22e-645e-43c2-b909-c7a8fddf8593 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.179473 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086d22e-645e-43c2-b909-c7a8fddf8593 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.180887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 374/765] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:23.186280 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b91e-1dda-4894-8eee-ed9e7b20afe6 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.186736 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b91e-1dda-4894-8eee-ed9e7b20afe6 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.186850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0b91e-1dda-4894-8eee-ed9e7b20afe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.203955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-a4f0b91e-1dda-4894-8eee-ed9e7b20afe6 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:23.205113 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-a4f0b91e-1dda-4894-8eee-ed9e7b20afe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:23.278336 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 392/766] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:23 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:23.301927 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086d22e-645e-43c2-b909-c7a8fddf8593 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.406027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086d22e-645e-43c2-b909-c7a8fddf8593 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.440665 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a4eec-6c60-4764-84c8-1fa5f610319d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.441373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a4eec-6c60-4764-84c8-1fa5f610319d None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.441654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a4eec-6c60-4764-84c8-1fa5f610319d None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.441920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a4eec-6c60-4764-84c8-1fa5f610319d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.442606 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a4eec-6c60-4764-84c8-1fa5f610319d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.443976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a4eec-6c60-4764-84c8-1fa5f610319d None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-bf6a4eec-6c60-4764-84c8-1fa5f610319d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:23.455699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:23.456685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:23.457672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 375/767] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:23.462968 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b91e-1dda-4894-8eee-ed9e7b20afe6 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.563873 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0b91e-1dda-4894-8eee-ed9e7b20afe6 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.577343 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:23.602212 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c9722-9bf5-402b-a2da-2a5ab21d95e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.602905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c9722-9bf5-402b-a2da-2a5ab21d95e8 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.603189 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c9722-9bf5-402b-a2da-2a5ab21d95e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.603466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c9722-9bf5-402b-a2da-2a5ab21d95e8 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.604166 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c9722-9bf5-402b-a2da-2a5ab21d95e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:23.604476 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c9722-9bf5-402b-a2da-2a5ab21d95e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.605933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c9722-9bf5-402b-a2da-2a5ab21d95e8 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.610933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 393/768] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:23.616630 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a4eec-6c60-4764-84c8-1fa5f610319d None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.660021 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:23.724684 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a4eec-6c60-4764-84c8-1fa5f610319d None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.760423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1fbd6-5a9e-434e-a445-47a4a25cd5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.761080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1fbd6-5a9e-434e-a445-47a4a25cd5c2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.761362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1fbd6-5a9e-434e-a445-47a4a25cd5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.761625 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1fbd6-5a9e-434e-a445-47a4a25cd5c2 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.762453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1fbd6-5a9e-434e-a445-47a4a25cd5c2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:23.762768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1fbd6-5a9e-434e-a445-47a4a25cd5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.764153 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1fbd6-5a9e-434e-a445-47a4a25cd5c2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.769270 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 376/769] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:23.775360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c9722-9bf5-402b-a2da-2a5ab21d95e8 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:23.877516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c9722-9bf5-402b-a2da-2a5ab21d95e8 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:23.913846 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0051-c9cc-40dd-8040-0d294b740c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:23.914545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0051-c9cc-40dd-8040-0d294b740c07 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:23.914832 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0051-c9cc-40dd-8040-0d294b740c07 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:23.915109 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0051-c9cc-40dd-8040-0d294b740c07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:23.915907 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0051-c9cc-40dd-8040-0d294b740c07 None admin] RBAC: Adding query filter params (interface=public, service_id=7603433d144a4776ada9fa39ba2af53c, region_id=RegionOne) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:23.916220 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0051-c9cc-40dd-8040-0d294b740c07 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:23.917656 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0051-c9cc-40dd-8040-0d294b740c07 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:23.930810 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 394/770] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/endpoints?service_id=7603433d144a4776ada9fa39ba2af53c&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:23.931924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1fbd6-5a9e-434e-a445-47a4a25cd5c2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.034699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1fbd6-5a9e-434e-a445-47a4a25cd5c2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.037071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.072273 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466376b0-b311-477b-b82e-0cada43c3c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.072938 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466376b0-b311-477b-b82e-0cada43c3c53 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.073224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466376b0-b311-477b-b82e-0cada43c3c53 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.073503 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466376b0-b311-477b-b82e-0cada43c3c53 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.074190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466376b0-b311-477b-b82e-0cada43c3c53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.075645 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466376b0-b311-477b-b82e-0cada43c3c53 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.081806 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 377/771] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:23 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:36:24.142364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9404f-57d9-410f-9b04-fa457b49a184 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.142697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9404f-57d9-410f-9b04-fa457b49a184 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.142973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9404f-57d9-410f-9b04-fa457b49a184 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.144369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 395/772] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:24.150186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a5687-1da6-4c78-889e-627b7565bb3d None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.150481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a5687-1da6-4c78-889e-627b7565bb3d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.150778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a5687-1da6-4c78-889e-627b7565bb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.169125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-723a5687-1da6-4c78-889e-627b7565bb3d None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:24.170350 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-723a5687-1da6-4c78-889e-627b7565bb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:24.244039 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 378/773] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:24 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:24.269869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9404f-57d9-410f-9b04-fa457b49a184 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.315774 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.377802 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9404f-57d9-410f-9b04-fa457b49a184 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.414808 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f499c24-6629-497f-882c-26664d09f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.415615 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f499c24-6629-497f-882c-26664d09f502 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.415892 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f499c24-6629-497f-882c-26664d09f502 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.416166 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f499c24-6629-497f-882c-26664d09f502 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.416818 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f499c24-6629-497f-882c-26664d09f502 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.418374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f499c24-6629-497f-882c-26664d09f502 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-2f499c24-6629-497f-882c-26664d09f502 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:24.430847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:24.431806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:24.432814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 396/774] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:24.438317 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a5687-1da6-4c78-889e-627b7565bb3d None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.549429 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.553464 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a5687-1da6-4c78-889e-627b7565bb3d None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.588907 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8e68c-45fa-4c91-bd17-d3a2437fdb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.589493 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8e68c-45fa-4c91-bd17-d3a2437fdb92 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.589778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8e68c-45fa-4c91-bd17-d3a2437fdb92 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.590044 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8e68c-45fa-4c91-bd17-d3a2437fdb92 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.590955 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8e68c-45fa-4c91-bd17-d3a2437fdb92 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:24.591690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8e68c-45fa-4c91-bd17-d3a2437fdb92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.593022 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8e68c-45fa-4c91-bd17-d3a2437fdb92 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.598063 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 379/775] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:24.603696 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f499c24-6629-497f-882c-26664d09f502 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.709675 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f499c24-6629-497f-882c-26664d09f502 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.711311 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:24.750601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce94600-81af-4dc9-ac31-4e492b43f4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.751297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce94600-81af-4dc9-ac31-4e492b43f4ab None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.751572 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce94600-81af-4dc9-ac31-4e492b43f4ab None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.751848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce94600-81af-4dc9-ac31-4e492b43f4ab None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.752553 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce94600-81af-4dc9-ac31-4e492b43f4ab None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:24.752862 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce94600-81af-4dc9-ac31-4e492b43f4ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.754245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce94600-81af-4dc9-ac31-4e492b43f4ab None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.759247 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 397/776] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:24.765293 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8e68c-45fa-4c91-bd17-d3a2437fdb92 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:24.871088 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8e68c-45fa-4c91-bd17-d3a2437fdb92 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:24.906981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f263c-4799-4bad-9e17-463cc3836b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:24.907627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f263c-4799-4bad-9e17-463cc3836b56 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:24.907915 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f263c-4799-4bad-9e17-463cc3836b56 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:24.908194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f263c-4799-4bad-9e17-463cc3836b56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:24.908990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f263c-4799-4bad-9e17-463cc3836b56 None admin] RBAC: Adding query filter params (interface=public, service_id=9d86c2ef48f44ace8313a0501d3c95f1, region_id=RegionOne) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:24.909300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f263c-4799-4bad-9e17-463cc3836b56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:24.910709 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f263c-4799-4bad-9e17-463cc3836b56 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:24.915928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 380/777] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/endpoints?service_id=9d86c2ef48f44ace8313a0501d3c95f1&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:24.921700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce94600-81af-4dc9-ac31-4e492b43f4ab None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:25.022608 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce94600-81af-4dc9-ac31-4e492b43f4ab None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:25.057531 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c027f5-db48-44cf-83a3-c880bc4613d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:25.058188 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c027f5-db48-44cf-83a3-c880bc4613d3 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:25.058484 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c027f5-db48-44cf-83a3-c880bc4613d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:25.058814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c027f5-db48-44cf-83a3-c880bc4613d3 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:25.059513 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c027f5-db48-44cf-83a3-c880bc4613d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:25.060910 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c027f5-db48-44cf-83a3-c880bc4613d3 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:25.066888 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 398/778] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:24 2022] GET /identity/v3/services => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:36:26.382291 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cfe9d-f241-47a4-b1b3-21a850ddc639 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.382941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cfe9d-f241-47a4-b1b3-21a850ddc639 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.382941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79cfe9d-f241-47a4-b1b3-21a850ddc639 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.384342 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 381/779] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:26.389850 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5680839-552e-49e8-8c16-ed175506c1d8 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.390293 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5680839-552e-49e8-8c16-ed175506c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.390393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5680839-552e-49e8-8c16-ed175506c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.407794 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-b5680839-552e-49e8-8c16-ed175506c1d8 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:26.408984 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-b5680839-552e-49e8-8c16-ed175506c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:26.433697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.480283 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 399/780] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:26.504497 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cfe9d-f241-47a4-b1b3-21a850ddc639 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.533081 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.612202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79cfe9d-f241-47a4-b1b3-21a850ddc639 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.647470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e743f6-8110-4141-82c9-2b17ce731b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.648188 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e743f6-8110-4141-82c9-2b17ce731b42 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.648475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e743f6-8110-4141-82c9-2b17ce731b42 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.648752 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e743f6-8110-4141-82c9-2b17ce731b42 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.649404 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e743f6-8110-4141-82c9-2b17ce731b42 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.650848 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e743f6-8110-4141-82c9-2b17ce731b42 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-81e743f6-8110-4141-82c9-2b17ce731b42 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:26.663014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:26.664089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:26.664987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 382/781] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:26.670321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5680839-552e-49e8-8c16-ed175506c1d8 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.773956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5680839-552e-49e8-8c16-ed175506c1d8 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.809015 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed531a-de7c-4b95-97b4-e93c9d6a8e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.809679 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed531a-de7c-4b95-97b4-e93c9d6a8e0e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.809963 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed531a-de7c-4b95-97b4-e93c9d6a8e0e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.810238 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed531a-de7c-4b95-97b4-e93c9d6a8e0e None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.810974 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed531a-de7c-4b95-97b4-e93c9d6a8e0e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:26.811281 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed531a-de7c-4b95-97b4-e93c9d6a8e0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.812676 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed531a-de7c-4b95-97b4-e93c9d6a8e0e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.817661 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 400/782] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:26.823482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e743f6-8110-4141-82c9-2b17ce731b42 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:26.922720 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:26.936661 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e743f6-8110-4141-82c9-2b17ce731b42 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:26.972343 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c8563-6069-45fb-89e7-32f1fcfa1eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:26.973007 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c8563-6069-45fb-89e7-32f1fcfa1eb3 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:26.973291 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c8563-6069-45fb-89e7-32f1fcfa1eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:26.973570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c8563-6069-45fb-89e7-32f1fcfa1eb3 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:26.974281 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c8563-6069-45fb-89e7-32f1fcfa1eb3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:26.974624 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c8563-6069-45fb-89e7-32f1fcfa1eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:26.976010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c8563-6069-45fb-89e7-32f1fcfa1eb3 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:26.981147 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 383/783] 10.222.0.26 () {56 vars in 1114 bytes} [Sat Jun 25 20:36:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:26.986802 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed531a-de7c-4b95-97b4-e93c9d6a8e0e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.013218 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.094612 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed531a-de7c-4b95-97b4-e93c9d6a8e0e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.131025 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e1429-56fb-4547-9f25-960b05279194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.131685 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1429-56fb-4547-9f25-960b05279194 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.131972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1429-56fb-4547-9f25-960b05279194 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.132250 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e1429-56fb-4547-9f25-960b05279194 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.132992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e1429-56fb-4547-9f25-960b05279194 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.134394 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e1429-56fb-4547-9f25-960b05279194 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.153963 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 401/784] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:27.314318 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ed06f-adec-4bdc-a841-a54d475ab9a1 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.314644 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ed06f-adec-4bdc-a841-a54d475ab9a1 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.314928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ed06f-adec-4bdc-a841-a54d475ab9a1 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.316315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 384/785] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:27.321967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9f36-46b6-41de-83fc-2cfed779f90e None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.322233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9f36-46b6-41de-83fc-2cfed779f90e None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.322566 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b9f36-46b6-41de-83fc-2cfed779f90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.341171 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-f05b9f36-46b6-41de-83fc-2cfed779f90e None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:27.342705 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-f05b9f36-46b6-41de-83fc-2cfed779f90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:27.418361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 402/786] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:27 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:27.442079 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ed06f-adec-4bdc-a841-a54d475ab9a1 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.549710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ed06f-adec-4bdc-a841-a54d475ab9a1 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.585227 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e2b4-3eeb-4bdb-af09-f9a5d8374cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.585961 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e2b4-3eeb-4bdb-af09-f9a5d8374cb9 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.586242 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e2b4-3eeb-4bdb-af09-f9a5d8374cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.586559 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521e2b4-3eeb-4bdb-af09-f9a5d8374cb9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.587215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521e2b4-3eeb-4bdb-af09-f9a5d8374cb9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.588594 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521e2b4-3eeb-4bdb-af09-f9a5d8374cb9 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-8521e2b4-3eeb-4bdb-af09-f9a5d8374cb9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:27.602010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:27.603024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:27.603834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 385/787] 10.222.0.26 () {56 vars in 1132 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:27.609671 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9f36-46b6-41de-83fc-2cfed779f90e None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.618195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.712008 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b9f36-46b6-41de-83fc-2cfed779f90e None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.748480 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8eaf2-aa39-4bb5-baf0-d178c0d85ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.749243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8eaf2-aa39-4bb5-baf0-d178c0d85ea0 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.749580 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8eaf2-aa39-4bb5-baf0-d178c0d85ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.749853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8eaf2-aa39-4bb5-baf0-d178c0d85ea0 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.750660 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8eaf2-aa39-4bb5-baf0-d178c0d85ea0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:27.751031 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8eaf2-aa39-4bb5-baf0-d178c0d85ea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.752388 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8eaf2-aa39-4bb5-baf0-d178c0d85ea0 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.757405 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 403/788] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:27.763352 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e2b4-3eeb-4bdb-af09-f9a5d8374cb9 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.783847 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:27.865727 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521e2b4-3eeb-4bdb-af09-f9a5d8374cb9 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:27.901152 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c5405-c230-4313-9080-8e1d37bd1bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:27.901804 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c5405-c230-4313-9080-8e1d37bd1bec None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:27.902085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c5405-c230-4313-9080-8e1d37bd1bec None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:27.902440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c5405-c230-4313-9080-8e1d37bd1bec None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:27.903172 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c5405-c230-4313-9080-8e1d37bd1bec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:27.903476 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c5405-c230-4313-9080-8e1d37bd1bec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:27.904851 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c5405-c230-4313-9080-8e1d37bd1bec None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:27.910142 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 386/789] 10.222.0.26 () {56 vars in 1126 bytes} [Sat Jun 25 20:36:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:27.915693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8eaf2-aa39-4bb5-baf0-d178c0d85ea0 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:27.986983 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:28.018331 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8eaf2-aa39-4bb5-baf0-d178c0d85ea0 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:28.053270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124b77b-dc3e-4d01-b992-c4845ae735ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:28.053922 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b77b-dc3e-4d01-b992-c4845ae735ad None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:28.054184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b77b-dc3e-4d01-b992-c4845ae735ad None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:28.054512 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124b77b-dc3e-4d01-b992-c4845ae735ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:28.055253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b77b-dc3e-4d01-b992-c4845ae735ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:28.056604 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124b77b-dc3e-4d01-b992-c4845ae735ad None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:28.076100 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 404/790] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:29.438714 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d027040-86a1-41e1-a29a-ff3a2aa38292 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.439274 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d027040-86a1-41e1-a29a-ff3a2aa38292 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.439274 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d027040-86a1-41e1-a29a-ff3a2aa38292 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.440649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 387/791] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:29.446123 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb135ce-a478-489a-ad8a-0a948749db6f None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.446609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb135ce-a478-489a-ad8a-0a948749db6f None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.446833 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb135ce-a478-489a-ad8a-0a948749db6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.464780 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-2bb135ce-a478-489a-ad8a-0a948749db6f None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:29.466106 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-2bb135ce-a478-489a-ad8a-0a948749db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:29.547134 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 405/792] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:29 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:29.576430 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d027040-86a1-41e1-a29a-ff3a2aa38292 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.681768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:29.709054 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d027040-86a1-41e1-a29a-ff3a2aa38292 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.746522 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.747202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.747485 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.747761 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.748468 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.749908 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.751337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING keystone.server.flask.common [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 25 20:36:29.777135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.sql.core [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 25 20:36:29.777135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 25 20:36:29.777135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [parameters: {'id': 'bf18f2d42cfb401aa705b473729bda9d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 25 20:36:29.777135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93694) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf18f2d42cfb401aa705b473729bda9d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf18f2d42cfb401aa705b473729bda9d. Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:36:29.798901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application result.read() Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 25 20:36:29.800031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application yield resource Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.session.rollback() Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.force_reraise() Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise self.value Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application session.commit() Jun 25 20:36:29.801173 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._prepare_impl() Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.session.flush() Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._flush(objects) Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application compat.raise_( Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application flush_context.execute() Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 20:36:29.802308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rec.execute(self) Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 25 20:36:29.803392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application result.read() Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:36:29.804258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [parameters: {'id': 'bf18f2d42cfb401aa705b473729bda9d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:29.805305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:29.806110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bf18f2d42cfb401aa705b473729bda9d. Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:29.807184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 388/793] 10.222.0.26 () {60 vars in 1140 bytes} [Sat Jun 25 20:36:29 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:29.807852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb135ce-a478-489a-ad8a-0a948749db6f None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:29.867106 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:29.921899 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb135ce-a478-489a-ad8a-0a948749db6f None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:29.961054 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58938bfd-b841-4193-8979-7d89edfb22de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:29.962691 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58938bfd-b841-4193-8979-7d89edfb22de None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:29.962691 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58938bfd-b841-4193-8979-7d89edfb22de None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:29.962691 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58938bfd-b841-4193-8979-7d89edfb22de None admin] PATH_INFO: `/v3/projects/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:29.970083 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58938bfd-b841-4193-8979-7d89edfb22de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:29.971586 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58938bfd-b841-4193-8979-7d89edfb22de None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-58938bfd-b841-4193-8979-7d89edfb22de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:36:29.988050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:29.989141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:29.997327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:36:29.997327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:36:29.997327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:36:29.997327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:36:29.997327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:36:29.997327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:36:29.997327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:36:29.997327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:29.997327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 406/794] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:29.998526 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.115163 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc8717-0b10-4885-aa97-16c1970e95ea None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.154064 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b4308-12bd-4c08-864a-0387c0fa425b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.154823 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4308-12bd-4c08-864a-0387c0fa425b None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.155108 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4308-12bd-4c08-864a-0387c0fa425b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.155388 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b4308-12bd-4c08-864a-0387c0fa425b None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.156143 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b4308-12bd-4c08-864a-0387c0fa425b None admin] RBAC: Adding query filter params (name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:30.156452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b4308-12bd-4c08-864a-0387c0fa425b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.158110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b4308-12bd-4c08-864a-0387c0fa425b None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.171979 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:30.183105 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 389/795] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:29 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:30.441687 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c2f18-2673-4eda-9baf-5170a40c600c None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.441991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c2f18-2673-4eda-9baf-5170a40c600c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.442264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c2f18-2673-4eda-9baf-5170a40c600c None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.443659 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 407/796] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:30.449676 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b6576-a9ee-47bf-9f94-ff36691f4230 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.450200 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b6576-a9ee-47bf-9f94-ff36691f4230 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.450495 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b6576-a9ee-47bf-9f94-ff36691f4230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.469238 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-eb4b6576-a9ee-47bf-9f94-ff36691f4230 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:30.470918 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-eb4b6576-a9ee-47bf-9f94-ff36691f4230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:30.543010 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 390/797] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:30 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:30.566756 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c2f18-2673-4eda-9baf-5170a40c600c None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.671549 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c2f18-2673-4eda-9baf-5170a40c600c None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.684359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:30.705830 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7262cf-9c69-48d2-b34a-13db3c10ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.706598 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7262cf-9c69-48d2-b34a-13db3c10ed79 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.706884 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7262cf-9c69-48d2-b34a-13db3c10ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.707163 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7262cf-9c69-48d2-b34a-13db3c10ed79 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.707822 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7262cf-9c69-48d2-b34a-13db3c10ed79 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.709220 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7262cf-9c69-48d2-b34a-13db3c10ed79 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-de7262cf-9c69-48d2-b34a-13db3c10ed79 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:30.721622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:30.722658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:30.723498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 408/798] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:30.729124 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b6576-a9ee-47bf-9f94-ff36691f4230 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.834806 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b6576-a9ee-47bf-9f94-ff36691f4230 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:30.862548 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:30.871145 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d0d2-92f7-4c99-bf56-05f3714885ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:30.871892 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d0d2-92f7-4c99-bf56-05f3714885ad None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:30.872179 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d0d2-92f7-4c99-bf56-05f3714885ad None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:30.872455 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d0d2-92f7-4c99-bf56-05f3714885ad None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:30.873166 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d0d2-92f7-4c99-bf56-05f3714885ad None admin] RBAC: Adding query filter params (name=compute) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:30.873475 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d0d2-92f7-4c99-bf56-05f3714885ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:30.874892 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d0d2-92f7-4c99-bf56-05f3714885ad None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:30.879867 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 391/799] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:30.885475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7262cf-9c69-48d2-b34a-13db3c10ed79 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:30.988640 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7262cf-9c69-48d2-b34a-13db3c10ed79 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:31.023638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd65d5-5521-4b16-8efb-2740a34cafa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:31.024300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd65d5-5521-4b16-8efb-2740a34cafa5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:31.024586 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd65d5-5521-4b16-8efb-2740a34cafa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:31.024866 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd65d5-5521-4b16-8efb-2740a34cafa5 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:31.025574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd65d5-5521-4b16-8efb-2740a34cafa5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:31.025883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd65d5-5521-4b16-8efb-2740a34cafa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:31.027332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd65d5-5521-4b16-8efb-2740a34cafa5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:31.031945 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 409/800] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:32.510948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595f780-e4e6-42ef-8a6f-c20d2b48b288 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.511576 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595f780-e4e6-42ef-8a6f-c20d2b48b288 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.511576 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595f780-e4e6-42ef-8a6f-c20d2b48b288 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.513380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 392/801] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:32.518898 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde770c4-0099-4517-9727-5950d23f5e27 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.519329 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde770c4-0099-4517-9727-5950d23f5e27 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.519434 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde770c4-0099-4517-9727-5950d23f5e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.536594 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-fde770c4-0099-4517-9727-5950d23f5e27 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:32.537771 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-fde770c4-0099-4517-9727-5950d23f5e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:32.573699 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:32.607842 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 410/802] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:32 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 25 20:36:32.633380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595f780-e4e6-42ef-8a6f-c20d2b48b288 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.741043 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595f780-e4e6-42ef-8a6f-c20d2b48b288 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.775935 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.776512 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.776789 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.777088 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.777897 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.779301 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.792900 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.sql.core [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 25 20:36:32.792900 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 25 20:36:32.792900 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [parameters: {'user_id': '4c120270b8e647518ee5ccc832749386', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 25 20:36:32.792900 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93694) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application result.read() Jun 25 20:36:32.800283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:36:32.801186 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application yield resource Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application next(self.gen) Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.session.rollback() Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.force_reraise() Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise self.value Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application session.commit() Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 25 20:36:32.802176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._prepare_impl() Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.session.flush() Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._flush(objects) Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application compat.raise_( Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application flush_context.execute() Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rec.execute(self) Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 25 20:36:32.803078 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 25 20:36:32.803968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application result = self._query(query) Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application conn.query(q) Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application result.read() Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 25 20:36:32.804812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [parameters: {'user_id': '4c120270b8e647518ee5ccc832749386', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:32.805626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 25 20:36:32.807889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 25 20:36:32.809311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 25 20:36:32.809311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 25 20:36:32.809311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 25 20:36:32.809311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 25 20:36:32.809311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 25 20:36:32.809311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:32.809311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 393/803] 10.222.0.26 () {60 vars in 1131 bytes} [Sat Jun 25 20:36:32 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:32.809901 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde770c4-0099-4517-9727-5950d23f5e27 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:32.906973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde770c4-0099-4517-9727-5950d23f5e27 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:32.959509 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b831673-563a-4955-a45b-14e8c953e665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:32.960322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b831673-563a-4955-a45b-14e8c953e665 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:32.960610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b831673-563a-4955-a45b-14e8c953e665 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:32.960885 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b831673-563a-4955-a45b-14e8c953e665 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:32.968402 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b831673-563a-4955-a45b-14e8c953e665 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:32.969875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b831673-563a-4955-a45b-14e8c953e665 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-3b831673-563a-4955-a45b-14e8c953e665 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:36:32.984240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:32.985183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:32.986099 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 411/804] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:36:32.991773 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:33.055987 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:33.105093 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc46eeb-f21f-4db7-9597-ca7f88d54f4f None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:33.139801 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b26f6-4961-4a3b-bef8-5b215d23f7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:33.140590 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b26f6-4961-4a3b-bef8-5b215d23f7c4 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:33.140941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b26f6-4961-4a3b-bef8-5b215d23f7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:33.141309 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b26f6-4961-4a3b-bef8-5b215d23f7c4 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:33.142194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b26f6-4961-4a3b-bef8-5b215d23f7c4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:33.142614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b26f6-4961-4a3b-bef8-5b215d23f7c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:33.144283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b26f6-4961-4a3b-bef8-5b215d23f7c4 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:33.185303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 394/805] 10.222.0.26 () {56 vars in 1101 bytes} [Sat Jun 25 20:36:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:33.272494 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb101f2-1cdb-49e9-949a-9dd2b2a956f2 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:33.272899 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb101f2-1cdb-49e9-949a-9dd2b2a956f2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:33.273244 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb101f2-1cdb-49e9-949a-9dd2b2a956f2 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:33.274723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 412/806] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:33.280684 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54583cf-3614-4ae8-97d8-6e0a1a2d8195 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:33.280971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54583cf-3614-4ae8-97d8-6e0a1a2d8195 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:33.281249 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54583cf-3614-4ae8-97d8-6e0a1a2d8195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:33.299559 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-e54583cf-3614-4ae8-97d8-6e0a1a2d8195 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:33.301112 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-e54583cf-3614-4ae8-97d8-6e0a1a2d8195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:33.374375 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 395/807] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:33 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:33.398088 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb101f2-1cdb-49e9-949a-9dd2b2a956f2 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:33.431144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:33.504061 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb101f2-1cdb-49e9-949a-9dd2b2a956f2 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:33.538366 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887dd07-64a9-43bf-b0db-8870f286b02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:33.539012 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dd07-64a9-43bf-b0db-8870f286b02f None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:33.539333 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dd07-64a9-43bf-b0db-8870f286b02f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:33.539613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887dd07-64a9-43bf-b0db-8870f286b02f None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:33.540338 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887dd07-64a9-43bf-b0db-8870f286b02f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:33.541766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1887dd07-64a9-43bf-b0db-8870f286b02f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:33.561228 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 413/808] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:36:33 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:35.837916 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b26c0-8f2e-4e96-bc63-192319aec9a7 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.838818 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b26c0-8f2e-4e96-bc63-192319aec9a7 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.839200 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b26c0-8f2e-4e96-bc63-192319aec9a7 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.842169 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 396/809] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:35.847542 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb4b23-2490-4759-ba5e-e66ed44267b3 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:35.847967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb4b23-2490-4759-ba5e-e66ed44267b3 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:35.848054 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb4b23-2490-4759-ba5e-e66ed44267b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:35.872153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-55fb4b23-2490-4759-ba5e-e66ed44267b3 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:35.873346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-55fb4b23-2490-4759-ba5e-e66ed44267b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:35.950364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 414/810] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:35 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:35.976382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b26c0-8f2e-4e96-bc63-192319aec9a7 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.025875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.085538 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b26c0-8f2e-4e96-bc63-192319aec9a7 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.129753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7ada7-0c6b-471e-b832-6b3f13c97a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.130902 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ada7-0c6b-471e-b832-6b3f13c97a71 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.131327 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ada7-0c6b-471e-b832-6b3f13c97a71 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.131723 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e7ada7-0c6b-471e-b832-6b3f13c97a71 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.132778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7ada7-0c6b-471e-b832-6b3f13c97a71 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.135101 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e7ada7-0c6b-471e-b832-6b3f13c97a71 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-c9e7ada7-0c6b-471e-b832-6b3f13c97a71 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:36.147779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:36.148883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:36:36.153968 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 397/811] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:36.155220 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb4b23-2490-4759-ba5e-e66ed44267b3 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.173663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.259496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb4b23-2490-4759-ba5e-e66ed44267b3 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.299896 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215cf9a-6cd0-464c-a12a-453311900c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.300570 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215cf9a-6cd0-464c-a12a-453311900c6f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.300852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215cf9a-6cd0-464c-a12a-453311900c6f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.301126 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215cf9a-6cd0-464c-a12a-453311900c6f None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.301835 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215cf9a-6cd0-464c-a12a-453311900c6f None admin] RBAC: Adding query filter params (name=compute) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:36.302142 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215cf9a-6cd0-464c-a12a-453311900c6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.303607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215cf9a-6cd0-464c-a12a-453311900c6f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.309396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 415/812] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:36.315277 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7ada7-0c6b-471e-b832-6b3f13c97a71 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.420215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e7ada7-0c6b-471e-b832-6b3f13c97a71 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.427778 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.457959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca4fb7-86aa-4417-b1bc-d9e186c5bbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.458643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4fb7-86aa-4417-b1bc-d9e186c5bbc6 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.458927 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4fb7-86aa-4417-b1bc-d9e186c5bbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.459210 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4fb7-86aa-4417-b1bc-d9e186c5bbc6 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.459920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca4fb7-86aa-4417-b1bc-d9e186c5bbc6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:36.460228 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca4fb7-86aa-4417-b1bc-d9e186c5bbc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.461624 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca4fb7-86aa-4417-b1bc-d9e186c5bbc6 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.467188 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 398/813] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:36.474003 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215cf9a-6cd0-464c-a12a-453311900c6f None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.570116 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:36.605906 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215cf9a-6cd0-464c-a12a-453311900c6f None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.643030 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d572a-b870-4304-8dc4-0a4917b5a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.643689 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d572a-b870-4304-8dc4-0a4917b5a194 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.643974 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d572a-b870-4304-8dc4-0a4917b5a194 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.644254 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d572a-b870-4304-8dc4-0a4917b5a194 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.645045 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d572a-b870-4304-8dc4-0a4917b5a194 None admin] RBAC: Adding query filter params (interface=public, service_id=1332846f1455479e99064b35fa70e29a, region_id=RegionOne) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:36.645361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d572a-b870-4304-8dc4-0a4917b5a194 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.646987 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d572a-b870-4304-8dc4-0a4917b5a194 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.652532 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 416/814] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/endpoints?service_id=1332846f1455479e99064b35fa70e29a&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:36.659788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca4fb7-86aa-4417-b1bc-d9e186c5bbc6 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:36.775236 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca4fb7-86aa-4417-b1bc-d9e186c5bbc6 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:36.810293 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944944d8-6257-4384-8cb7-95f5ea45077f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:36.810976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944944d8-6257-4384-8cb7-95f5ea45077f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:36.811264 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944944d8-6257-4384-8cb7-95f5ea45077f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:36.811540 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944944d8-6257-4384-8cb7-95f5ea45077f None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:36.812220 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944944d8-6257-4384-8cb7-95f5ea45077f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:36.813636 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944944d8-6257-4384-8cb7-95f5ea45077f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:36.820642 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 399/815] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Jun 25 20:36:36 2022] GET /identity/v3/services => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:36:39.071060 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e30933-3338-42a3-b5ec-8649b053efb0 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.071640 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e30933-3338-42a3-b5ec-8649b053efb0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.071640 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e30933-3338-42a3-b5ec-8649b053efb0 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.072958 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 417/816] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:36:39.079679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91128-8bd0-466b-8a0e-9f3c7fa22aaf None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.080386 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91128-8bd0-466b-8a0e-9f3c7fa22aaf None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.080569 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca91128-8bd0-466b-8a0e-9f3c7fa22aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.108897 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-eca91128-8bd0-466b-8a0e-9f3c7fa22aaf None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:36:39.110107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-eca91128-8bd0-466b-8a0e-9f3c7fa22aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:36:39.137843 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:39.180217 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 400/817] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:36:39 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:36:39.205262 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e30933-3338-42a3-b5ec-8649b053efb0 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.309019 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e30933-3338-42a3-b5ec-8649b053efb0 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.345062 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a905cd-5370-48c0-90cb-736c5abd5671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.345840 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a905cd-5370-48c0-90cb-736c5abd5671 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.346120 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a905cd-5370-48c0-90cb-736c5abd5671 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.346396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a905cd-5370-48c0-90cb-736c5abd5671 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.347069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a905cd-5370-48c0-90cb-736c5abd5671 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.348450 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a905cd-5370-48c0-90cb-736c5abd5671 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-a7a905cd-5370-48c0-90cb-736c5abd5671 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:36:39.360516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:36:39.361643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:36:39.362693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 418/818] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:36:39.367888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91128-8bd0-466b-8a0e-9f3c7fa22aaf None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.494872 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca91128-8bd0-466b-8a0e-9f3c7fa22aaf None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.530459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b88ca-acb4-42e0-92df-e6a4e376fee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.531131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b88ca-acb4-42e0-92df-e6a4e376fee6 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.531418 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b88ca-acb4-42e0-92df-e6a4e376fee6 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.531697 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b88ca-acb4-42e0-92df-e6a4e376fee6 None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.532410 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b88ca-acb4-42e0-92df-e6a4e376fee6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:39.532722 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b88ca-acb4-42e0-92df-e6a4e376fee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.534102 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b88ca-acb4-42e0-92df-e6a4e376fee6 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.539040 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 401/819] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:36:39.548227 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a905cd-5370-48c0-90cb-736c5abd5671 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.563516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:39.663912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a905cd-5370-48c0-90cb-736c5abd5671 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.700034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191a451-32b0-4ace-a376-dd743a622323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.700684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191a451-32b0-4ace-a376-dd743a622323 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.700962 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191a451-32b0-4ace-a376-dd743a622323 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.701236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191a451-32b0-4ace-a376-dd743a622323 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.701938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191a451-32b0-4ace-a376-dd743a622323 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:36:39.702222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191a451-32b0-4ace-a376-dd743a622323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.703673 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f191a451-32b0-4ace-a376-dd743a622323 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.708722 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 419/820] 10.222.0.26 () {56 vars in 1112 bytes} [Sat Jun 25 20:36:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:36:39.715494 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b88ca-acb4-42e0-92df-e6a4e376fee6 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:36:39.751223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:39.829235 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b88ca-acb4-42e0-92df-e6a4e376fee6 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:36:39.866721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65f26c-1235-445a-b736-60b7d1b67c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:36:39.867373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65f26c-1235-445a-b736-60b7d1b67c27 None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:36:39.867653 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65f26c-1235-445a-b736-60b7d1b67c27 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:36:39.867923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65f26c-1235-445a-b736-60b7d1b67c27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:36:39.868663 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65f26c-1235-445a-b736-60b7d1b67c27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:36:39.870036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65f26c-1235-445a-b736-60b7d1b67c27 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:36:39.893511 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 402/821] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Jun 25 20:36:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:36:49.706057 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=64 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:36:49.889282 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:41.823842 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089faad1-c7ad-41af-bde8-673960b51722 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:41.828487 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089faad1-c7ad-41af-bde8-673960b51722 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:41.828487 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089faad1-c7ad-41af-bde8-673960b51722 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:41.828487 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 420/822] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:37:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:41.836125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3246b8-25c2-4d35-9beb-6a7f0aa0074c None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:41.836125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3246b8-25c2-4d35-9beb-6a7f0aa0074c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:41.836125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3246b8-25c2-4d35-9beb-6a7f0aa0074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:41.859731 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-aa3246b8-25c2-4d35-9beb-6a7f0aa0074c None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:41.861142 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-aa3246b8-25c2-4d35-9beb-6a7f0aa0074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:41.957817 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 403/823] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:41.985092 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089faad1-c7ad-41af-bde8-673960b51722 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:42.108228 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089faad1-c7ad-41af-bde8-673960b51722 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:42.144378 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686603f-a72c-46b6-9fd9-44b2998550ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:42.145184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686603f-a72c-46b6-9fd9-44b2998550ba None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:42.145484 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686603f-a72c-46b6-9fd9-44b2998550ba None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:42.145758 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686603f-a72c-46b6-9fd9-44b2998550ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:42.161216 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686603f-a72c-46b6-9fd9-44b2998550ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:42.162859 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686603f-a72c-46b6-9fd9-44b2998550ba None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-9686603f-a72c-46b6-9fd9-44b2998550ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:42.182869 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:42.184245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:42.185386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:42.185386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:42.185386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:42.185386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:37:42.189212 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 421/824] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:42.190673 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3246b8-25c2-4d35-9beb-6a7f0aa0074c None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:42.308707 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3246b8-25c2-4d35-9beb-6a7f0aa0074c None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:42.345255 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:42.358595 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6198d7ea-d153-4ff7-aec9-0e23aea7839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:42.359239 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d7ea-d153-4ff7-aec9-0e23aea7839e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:42.359567 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d7ea-d153-4ff7-aec9-0e23aea7839e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:42.359852 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6198d7ea-d153-4ff7-aec9-0e23aea7839e None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:42.360594 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198d7ea-d153-4ff7-aec9-0e23aea7839e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:42.360903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198d7ea-d153-4ff7-aec9-0e23aea7839e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:42.362446 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6198d7ea-d153-4ff7-aec9-0e23aea7839e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:42.378665 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 404/825] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:42.385032 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686603f-a72c-46b6-9fd9-44b2998550ba None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:42.440747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:42.494411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686603f-a72c-46b6-9fd9-44b2998550ba None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:42.533571 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c53b1-60d2-464d-996d-34b0ef849915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:42.534248 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c53b1-60d2-464d-996d-34b0ef849915 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:42.534680 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c53b1-60d2-464d-996d-34b0ef849915 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:42.534868 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c53b1-60d2-464d-996d-34b0ef849915 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:42.535535 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c53b1-60d2-464d-996d-34b0ef849915 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:42.536985 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c53b1-60d2-464d-996d-34b0ef849915 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:42.568959 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 422/826] 10.222.0.26 () {60 vars in 1132 bytes} [Sat Jun 25 20:37:42 2022] POST /identity/v3/users => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:37:45.032116 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470afd2-efd6-48a5-8f3f-d2ae2d6f7438 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.032669 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470afd2-efd6-48a5-8f3f-d2ae2d6f7438 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.032669 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470afd2-efd6-48a5-8f3f-d2ae2d6f7438 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.034039 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 405/827] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:45.041216 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de93d2b-1f5d-4c29-b805-9423505f8ffa None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.042097 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de93d2b-1f5d-4c29-b805-9423505f8ffa None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.042097 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de93d2b-1f5d-4c29-b805-9423505f8ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.060913 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-9de93d2b-1f5d-4c29-b805-9423505f8ffa None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:45.062112 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-9de93d2b-1f5d-4c29-b805-9423505f8ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:45.135843 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 423/828] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:45 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:45.160288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470afd2-efd6-48a5-8f3f-d2ae2d6f7438 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:45.272081 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470afd2-efd6-48a5-8f3f-d2ae2d6f7438 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:45.308085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d79ac1-6fa8-4f02-b985-1b7c1eb4bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:45.308969 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d79ac1-6fa8-4f02-b985-1b7c1eb4bd2b None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.309288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d79ac1-6fa8-4f02-b985-1b7c1eb4bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.309590 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d79ac1-6fa8-4f02-b985-1b7c1eb4bd2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.321517 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d79ac1-6fa8-4f02-b985-1b7c1eb4bd2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-28d79ac1-6fa8-4f02-b985-1b7c1eb4bd2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:45.330528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:45.331757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:45.332839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 406/829] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:37:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:45.337932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de93d2b-1f5d-4c29-b805-9423505f8ffa None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:45.380293 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:45.447388 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de93d2b-1f5d-4c29-b805-9423505f8ffa None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:45.486933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ee94c-24a6-486a-8ba9-dacab35781a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:45.487710 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ee94c-24a6-486a-8ba9-dacab35781a1 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.488035 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ee94c-24a6-486a-8ba9-dacab35781a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.488340 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ee94c-24a6-486a-8ba9-dacab35781a1 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.489217 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ee94c-24a6-486a-8ba9-dacab35781a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:45.489563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ee94c-24a6-486a-8ba9-dacab35781a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:45.491298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ee94c-24a6-486a-8ba9-dacab35781a1 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:45.500480 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 424/830] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:37:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:45.506265 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d79ac1-6fa8-4f02-b985-1b7c1eb4bd2b None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:45.555903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:45.613183 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d79ac1-6fa8-4f02-b985-1b7c1eb4bd2b None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:45.653114 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8edc4-46df-4bb7-81c6-99177778a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:45.654680 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8edc4-46df-4bb7-81c6-99177778a915 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.654680 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8edc4-46df-4bb7-81c6-99177778a915 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.654680 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8edc4-46df-4bb7-81c6-99177778a915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.665505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8edc4-46df-4bb7-81c6-99177778a915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:45.666997 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8edc4-46df-4bb7-81c6-99177778a915 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-8ec8edc4-46df-4bb7-81c6-99177778a915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:45.684643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:45.686888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:45.688006 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:45.688006 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:45.688006 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:45.688006 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:45.688006 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 407/831] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:45.692883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ee94c-24a6-486a-8ba9-dacab35781a1 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:45.806506 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:45.810234 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ee94c-24a6-486a-8ba9-dacab35781a1 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:45.848138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49578ae0-8028-4c92-9068-ab23a17a92b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:45.848809 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49578ae0-8028-4c92-9068-ab23a17a92b3 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:45.849091 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49578ae0-8028-4c92-9068-ab23a17a92b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:45.849364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49578ae0-8028-4c92-9068-ab23a17a92b3 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:45.850081 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49578ae0-8028-4c92-9068-ab23a17a92b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:45.850448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49578ae0-8028-4c92-9068-ab23a17a92b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:45.852028 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49578ae0-8028-4c92-9068-ab23a17a92b3 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:45.865187 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 425/832] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:45.871240 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8edc4-46df-4bb7-81c6-99177778a915 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:45.980400 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:45.984043 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8edc4-46df-4bb7-81c6-99177778a915 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:46.020916 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48884ac1-5a33-46d5-aa4f-396770c57066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:46.021728 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48884ac1-5a33-46d5-aa4f-396770c57066 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:46.022035 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48884ac1-5a33-46d5-aa4f-396770c57066 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:46.022312 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48884ac1-5a33-46d5-aa4f-396770c57066 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:46.029787 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48884ac1-5a33-46d5-aa4f-396770c57066 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:46.031360 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48884ac1-5a33-46d5-aa4f-396770c57066 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-48884ac1-5a33-46d5-aa4f-396770c57066 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:37:46.046963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:46.048454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:37:46.049380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:46.052846 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 408/833] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:46.054030 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49578ae0-8028-4c92-9068-ab23a17a92b3 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:46.162957 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49578ae0-8028-4c92-9068-ab23a17a92b3 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:46.203767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edf736-b2db-4f17-ab7e-cd00c949272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:46.204524 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edf736-b2db-4f17-ab7e-cd00c949272d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:46.204886 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edf736-b2db-4f17-ab7e-cd00c949272d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:46.205197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16edf736-b2db-4f17-ab7e-cd00c949272d None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:46.206181 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edf736-b2db-4f17-ab7e-cd00c949272d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:46.206527 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edf736-b2db-4f17-ab7e-cd00c949272d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:46.207982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16edf736-b2db-4f17-ab7e-cd00c949272d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:46.226971 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 426/834] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Jun 25 20:37:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:46.232707 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48884ac1-5a33-46d5-aa4f-396770c57066 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:46.341175 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48884ac1-5a33-46d5-aa4f-396770c57066 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:46.378405 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dda1d-5930-4727-9730-6b3636f30287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:46.379205 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dda1d-5930-4727-9730-6b3636f30287 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:46.379500 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dda1d-5930-4727-9730-6b3636f30287 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:46.379795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dda1d-5930-4727-9730-6b3636f30287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:46.408643 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:46.455159 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dda1d-5930-4727-9730-6b3636f30287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:46.456674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952dda1d-5930-4727-9730-6b3636f30287 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:46.561969 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 409/835] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:46 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:46.568376 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edf736-b2db-4f17-ab7e-cd00c949272d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:46.590059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:46.686806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16edf736-b2db-4f17-ab7e-cd00c949272d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:46.723478 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001aae-cfca-4e9c-be34-af2c60deefed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:46.724289 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001aae-cfca-4e9c-be34-af2c60deefed None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:46.724632 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001aae-cfca-4e9c-be34-af2c60deefed None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:46.724911 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4001aae-cfca-4e9c-be34-af2c60deefed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:46.735518 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001aae-cfca-4e9c-be34-af2c60deefed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:46.737055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4001aae-cfca-4e9c-be34-af2c60deefed None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-d4001aae-cfca-4e9c-be34-af2c60deefed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:46.756128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:46.757263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:46.758545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:46.758545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:46.758545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:46.758545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:37:46.758545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 427/836] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:46.763379 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dda1d-5930-4727-9730-6b3636f30287 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:46.825603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:46.869994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952dda1d-5930-4727-9730-6b3636f30287 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:46.907392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68094170-3cdf-4cf5-afa4-ebeb0130252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:46.908366 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68094170-3cdf-4cf5-afa4-ebeb0130252e None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:46.908827 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68094170-3cdf-4cf5-afa4-ebeb0130252e None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:46.909210 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68094170-3cdf-4cf5-afa4-ebeb0130252e None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:46.910169 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68094170-3cdf-4cf5-afa4-ebeb0130252e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:46.910586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68094170-3cdf-4cf5-afa4-ebeb0130252e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:46.912052 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68094170-3cdf-4cf5-afa4-ebeb0130252e None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:46.929938 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 410/837] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:46.931965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001aae-cfca-4e9c-be34-af2c60deefed None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:47.010033 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:47.043001 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4001aae-cfca-4e9c-be34-af2c60deefed None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:47.079177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de36b-6cc8-4040-aaa9-46eee6ce1ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:47.080079 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de36b-6cc8-4040-aaa9-46eee6ce1ce5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:47.080259 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de36b-6cc8-4040-aaa9-46eee6ce1ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:47.080498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1de36b-6cc8-4040-aaa9-46eee6ce1ce5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:47.087707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de36b-6cc8-4040-aaa9-46eee6ce1ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:47.090140 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1de36b-6cc8-4040-aaa9-46eee6ce1ce5 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-5c1de36b-6cc8-4040-aaa9-46eee6ce1ce5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:37:47.105956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:47.107133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:47.108153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:37:47.108153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:37:47.108153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:47.108153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:47.108153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:47.108153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:47.108153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:47.108153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:37:47.108153 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 428/838] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:47.113288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68094170-3cdf-4cf5-afa4-ebeb0130252e None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:47.220715 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68094170-3cdf-4cf5-afa4-ebeb0130252e None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:47.238986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:47.257884 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4301dc-d5fb-4bbb-9689-9174b6b2f2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:47.258685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4301dc-d5fb-4bbb-9689-9174b6b2f2bd None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:47.258971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4301dc-d5fb-4bbb-9689-9174b6b2f2bd None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:47.259252 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4301dc-d5fb-4bbb-9689-9174b6b2f2bd None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:47.260086 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4301dc-d5fb-4bbb-9689-9174b6b2f2bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:47.260361 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4301dc-d5fb-4bbb-9689-9174b6b2f2bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:47.261977 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4301dc-d5fb-4bbb-9689-9174b6b2f2bd None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:47.275393 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 411/839] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:47.281642 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de36b-6cc8-4040-aaa9-46eee6ce1ce5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:47.389494 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1de36b-6cc8-4040-aaa9-46eee6ce1ce5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:47.420376 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:47.426907 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f81ef0-cb80-4d65-b226-a3ae11a3d806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:47.427579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f81ef0-cb80-4d65-b226-a3ae11a3d806 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:47.427835 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f81ef0-cb80-4d65-b226-a3ae11a3d806 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:47.428124 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f81ef0-cb80-4d65-b226-a3ae11a3d806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:47.428935 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f81ef0-cb80-4d65-b226-a3ae11a3d806 None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=d91c64b1ed4e49c7870ac00844b29bb4) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:47.429249 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f81ef0-cb80-4d65-b226-a3ae11a3d806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:47.430828 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f81ef0-cb80-4d65-b226-a3ae11a3d806 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:47.436730 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 429/840] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:47 2022] GET /identity/v3/role_assignments?user.id=d91c64b1ed4e49c7870ac00844b29bb4&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:49.801094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c93fd-2938-4b55-8370-38b9847e3ba2 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:49.801094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c93fd-2938-4b55-8370-38b9847e3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:49.801094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c93fd-2938-4b55-8370-38b9847e3ba2 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:49.801940 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 412/841] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:49.808027 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4696450-8eeb-45f6-80e2-f49a5be21927 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:49.808426 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4696450-8eeb-45f6-80e2-f49a5be21927 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:49.808591 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4696450-8eeb-45f6-80e2-f49a5be21927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:49.826682 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-b4696450-8eeb-45f6-80e2-f49a5be21927 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:49.827903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-b4696450-8eeb-45f6-80e2-f49a5be21927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:49.902956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 430/842] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:49.928954 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c93fd-2938-4b55-8370-38b9847e3ba2 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:50.035429 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c93fd-2938-4b55-8370-38b9847e3ba2 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:50.072754 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64498-6784-454f-be2d-0d7ab9f34fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:50.073634 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64498-6784-454f-be2d-0d7ab9f34fdc None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:50.073990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64498-6784-454f-be2d-0d7ab9f34fdc None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:50.074297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d64498-6784-454f-be2d-0d7ab9f34fdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:50.085767 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d64498-6784-454f-be2d-0d7ab9f34fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-12d64498-6784-454f-be2d-0d7ab9f34fdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:50.094370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:50.095552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:50.096521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 413/843] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:50.102308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4696450-8eeb-45f6-80e2-f49a5be21927 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:50.217197 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4696450-8eeb-45f6-80e2-f49a5be21927 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:50.247689 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:50.268613 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4718b-16a9-4d1d-86eb-56f1fcd98f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:50.269374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4718b-16a9-4d1d-86eb-56f1fcd98f76 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:50.269662 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4718b-16a9-4d1d-86eb-56f1fcd98f76 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:50.269943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4718b-16a9-4d1d-86eb-56f1fcd98f76 None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:50.270897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4718b-16a9-4d1d-86eb-56f1fcd98f76 None admin] RBAC: Adding query filter params (name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:50.271209 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4718b-16a9-4d1d-86eb-56f1fcd98f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:50.272618 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4718b-16a9-4d1d-86eb-56f1fcd98f76 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:50.282067 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 431/844] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:50.287826 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64498-6784-454f-be2d-0d7ab9f34fdc None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:50.331003 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:50.397440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d64498-6784-454f-be2d-0d7ab9f34fdc None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:50.431846 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7078e-bfa6-492d-bcdc-5a3f40d86028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:50.432645 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7078e-bfa6-492d-bcdc-5a3f40d86028 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:50.432931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7078e-bfa6-492d-bcdc-5a3f40d86028 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:50.433217 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7078e-bfa6-492d-bcdc-5a3f40d86028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:50.445542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7078e-bfa6-492d-bcdc-5a3f40d86028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:50.447507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7078e-bfa6-492d-bcdc-5a3f40d86028 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-03e7078e-bfa6-492d-bcdc-5a3f40d86028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:50.467928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:50.468971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:50.469943 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:50.469943 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:50.469943 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:50.469943 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:50.469943 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 414/845] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:50.475375 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4718b-16a9-4d1d-86eb-56f1fcd98f76 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:50.583811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4718b-16a9-4d1d-86eb-56f1fcd98f76 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:50.622091 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c5765-391d-4ed4-8c9d-f7bb97a9cc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:50.622906 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c5765-391d-4ed4-8c9d-f7bb97a9cc6a None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:50.623359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c5765-391d-4ed4-8c9d-f7bb97a9cc6a None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:50.623645 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c5765-391d-4ed4-8c9d-f7bb97a9cc6a None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:50.624616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c5765-391d-4ed4-8c9d-f7bb97a9cc6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:50.624978 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c5765-391d-4ed4-8c9d-f7bb97a9cc6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:50.626683 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c5765-391d-4ed4-8c9d-f7bb97a9cc6a None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:50.641689 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 432/846] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:50.648449 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7078e-bfa6-492d-bcdc-5a3f40d86028 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:50.748777 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:50.759601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7078e-bfa6-492d-bcdc-5a3f40d86028 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:50.795228 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e96f5-1805-4a23-9b3e-6bf499a2c4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:50.796108 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e96f5-1805-4a23-9b3e-6bf499a2c4f2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:50.796388 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e96f5-1805-4a23-9b3e-6bf499a2c4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:50.796666 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e96f5-1805-4a23-9b3e-6bf499a2c4f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:50.808045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e96f5-1805-4a23-9b3e-6bf499a2c4f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:50.809611 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e96f5-1805-4a23-9b3e-6bf499a2c4f2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-632e96f5-1805-4a23-9b3e-6bf499a2c4f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:37:50.825838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:50.826965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:50.827953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 415/847] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:50.832905 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c5765-391d-4ed4-8c9d-f7bb97a9cc6a None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:50.884329 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:50.947444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c5765-391d-4ed4-8c9d-f7bb97a9cc6a None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:50.983041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2288a-e508-4aba-8802-1526961df817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:50.983717 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2288a-e508-4aba-8802-1526961df817 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:50.984054 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2288a-e508-4aba-8802-1526961df817 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:50.984346 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2288a-e508-4aba-8802-1526961df817 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:50.985232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2288a-e508-4aba-8802-1526961df817 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:50.985543 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2288a-e508-4aba-8802-1526961df817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:50.987034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e2288a-e508-4aba-8802-1526961df817 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:51.005122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 433/848] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Jun 25 20:37:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:51.010759 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e96f5-1805-4a23-9b3e-6bf499a2c4f2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:51.115764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e96f5-1805-4a23-9b3e-6bf499a2c4f2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:51.152758 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce04e0-837d-4c3f-b887-e0309ab46741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:51.153533 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce04e0-837d-4c3f-b887-e0309ab46741 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:51.153818 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce04e0-837d-4c3f-b887-e0309ab46741 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:51.154144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce04e0-837d-4c3f-b887-e0309ab46741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:51.166234 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce04e0-837d-4c3f-b887-e0309ab46741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:51.167817 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce04e0-837d-4c3f-b887-e0309ab46741 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-72ce04e0-837d-4c3f-b887-e0309ab46741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:51.187184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:51.188275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:51.189212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:51.189212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:51.189212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:51.189212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:51.189212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 416/849] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:37:51.194339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2288a-e508-4aba-8802-1526961df817 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:51.311382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e2288a-e508-4aba-8802-1526961df817 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:51.317068 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:51.360036 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ee209-966a-45b9-b783-8e81ab7fc651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:51.360697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ee209-966a-45b9-b783-8e81ab7fc651 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:51.361009 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ee209-966a-45b9-b783-8e81ab7fc651 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:51.361259 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ee209-966a-45b9-b783-8e81ab7fc651 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:51.361970 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ee209-966a-45b9-b783-8e81ab7fc651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:51.362273 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ee209-966a-45b9-b783-8e81ab7fc651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:51.363877 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ee209-966a-45b9-b783-8e81ab7fc651 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:51.376307 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 434/850] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:51.382040 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce04e0-837d-4c3f-b887-e0309ab46741 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:51.385284 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:51.506898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce04e0-837d-4c3f-b887-e0309ab46741 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:51.549363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd432e6-ffd6-416f-ad59-c6c3c1c345fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:51.550488 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd432e6-ffd6-416f-ad59-c6c3c1c345fc None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:51.550586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd432e6-ffd6-416f-ad59-c6c3c1c345fc None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:51.550832 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd432e6-ffd6-416f-ad59-c6c3c1c345fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:51.558524 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd432e6-ffd6-416f-ad59-c6c3c1c345fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:51.560084 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd432e6-ffd6-416f-ad59-c6c3c1c345fc None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-fcd432e6-ffd6-416f-ad59-c6c3c1c345fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:37:51.575941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:51.577176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:51.578223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:37:51.578223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:37:51.578223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:51.578223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:51.578223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:51.578223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:51.578223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:51.578223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:51.578223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 417/851] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:51.583275 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ee209-966a-45b9-b783-8e81ab7fc651 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:51.695438 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ee209-966a-45b9-b783-8e81ab7fc651 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:51.732469 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6c88c-8ece-499c-957e-499c0237f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:51.733207 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6c88c-8ece-499c-957e-499c0237f160 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:51.733516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6c88c-8ece-499c-957e-499c0237f160 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:51.733826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6c88c-8ece-499c-957e-499c0237f160 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:51.734751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6c88c-8ece-499c-957e-499c0237f160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:51.735071 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6c88c-8ece-499c-957e-499c0237f160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:51.736658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f6c88c-8ece-499c-957e-499c0237f160 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:51.760822 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 435/852] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:51.766780 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd432e6-ffd6-416f-ad59-c6c3c1c345fc None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:51.839755 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:51.880713 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd432e6-ffd6-416f-ad59-c6c3c1c345fc None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:51.917126 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e46ab-e678-474d-94e7-3defe8caf799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:51.918029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e46ab-e678-474d-94e7-3defe8caf799 None admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:51.918347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e46ab-e678-474d-94e7-3defe8caf799 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:51.918654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e46ab-e678-474d-94e7-3defe8caf799 None admin] PATH_INFO: `/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/d91c64b1ed4e49c7870ac00844b29bb4/roles/04404f6921a84a09bb039aaea888fca8` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:51.935540 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e46ab-e678-474d-94e7-3defe8caf799 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad8cd680e7d47a7a966e6f82e56ec87, user_id=d91c64b1ed4e49c7870ac00844b29bb4, role_id=04404f6921a84a09bb039aaea888fca8)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:51.937231 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e46ab-e678-474d-94e7-3defe8caf799 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:51.952379 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 418/853] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:37:51 2022] PUT /identity/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/d91c64b1ed4e49c7870ac00844b29bb4/roles/04404f6921a84a09bb039aaea888fca8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:37:54.387282 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b035ab-cb47-4b8b-b9b9-5016715bf01b None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:54.387875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b035ab-cb47-4b8b-b9b9-5016715bf01b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:54.387875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b035ab-cb47-4b8b-b9b9-5016715bf01b None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:54.389302 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 436/854] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:37:54.395189 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0eb2d-baa1-4ea8-ba27-eefcb1b02f41 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:54.395661 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0eb2d-baa1-4ea8-ba27-eefcb1b02f41 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:54.395752 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0eb2d-baa1-4ea8-ba27-eefcb1b02f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:54.412578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-20d0eb2d-baa1-4ea8-ba27-eefcb1b02f41 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:54.413770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-20d0eb2d-baa1-4ea8-ba27-eefcb1b02f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:54.486698 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 419/855] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:54 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:54.510976 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b035ab-cb47-4b8b-b9b9-5016715bf01b None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:54.539767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:54.626287 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b035ab-cb47-4b8b-b9b9-5016715bf01b None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:54.664203 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a4204-bce6-44ff-b751-81bd4497c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:54.665097 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4204-bce6-44ff-b751-81bd4497c3af None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:54.665444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4204-bce6-44ff-b751-81bd4497c3af None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:54.665725 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326a4204-bce6-44ff-b751-81bd4497c3af None admin] PATH_INFO: `/v3/roles/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:54.677205 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326a4204-bce6-44ff-b751-81bd4497c3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-326a4204-bce6-44ff-b751-81bd4497c3af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:54.685206 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:54.686285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:37:54.687327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 437/856] 10.222.0.26 () {56 vars in 1102 bytes} [Sat Jun 25 20:37:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:54.692556 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0eb2d-baa1-4ea8-ba27-eefcb1b02f41 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:54.736367 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:54.800732 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0eb2d-baa1-4ea8-ba27-eefcb1b02f41 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:54.836066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73704fec-7e95-4e6c-a330-bf2945dca475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:54.836743 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73704fec-7e95-4e6c-a330-bf2945dca475 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:54.837106 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73704fec-7e95-4e6c-a330-bf2945dca475 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:54.837385 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73704fec-7e95-4e6c-a330-bf2945dca475 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:54.838135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73704fec-7e95-4e6c-a330-bf2945dca475 None admin] RBAC: Adding query filter params (name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:54.838473 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73704fec-7e95-4e6c-a330-bf2945dca475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:54.839857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73704fec-7e95-4e6c-a330-bf2945dca475 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:54.849017 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 420/857] 10.222.0.26 () {56 vars in 1103 bytes} [Sat Jun 25 20:37:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:54.854871 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a4204-bce6-44ff-b751-81bd4497c3af None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:54.945178 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:54.963385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326a4204-bce6-44ff-b751-81bd4497c3af None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:55.001689 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc16db-553a-4b29-8961-60af975044b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:55.002716 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc16db-553a-4b29-8961-60af975044b2 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:55.002947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc16db-553a-4b29-8961-60af975044b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:55.003261 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc16db-553a-4b29-8961-60af975044b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:55.015520 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc16db-553a-4b29-8961-60af975044b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:55.017005 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bc16db-553a-4b29-8961-60af975044b2 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-f1bc16db-553a-4b29-8961-60af975044b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:55.034339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:55.035610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:55.036669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:55.036669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:55.036669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:55.036669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:37:55.036669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 438/858] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:55.041998 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73704fec-7e95-4e6c-a330-bf2945dca475 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:55.154490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73704fec-7e95-4e6c-a330-bf2945dca475 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:55.157257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:55.195006 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6c366-ef72-4bbd-8166-68ea235873e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:55.195604 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6c366-ef72-4bbd-8166-68ea235873e9 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:55.196020 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6c366-ef72-4bbd-8166-68ea235873e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:55.196382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6c366-ef72-4bbd-8166-68ea235873e9 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:55.197114 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6c366-ef72-4bbd-8166-68ea235873e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:55.197423 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6c366-ef72-4bbd-8166-68ea235873e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:55.198840 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6c366-ef72-4bbd-8166-68ea235873e9 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:55.210674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 421/859] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:55.217023 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc16db-553a-4b29-8961-60af975044b2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:55.326119 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc16db-553a-4b29-8961-60af975044b2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:55.366294 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cbc66-b75c-422b-bcca-5552b1890c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:55.369371 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cbc66-b75c-422b-bcca-5552b1890c1f None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:55.369667 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cbc66-b75c-422b-bcca-5552b1890c1f None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:55.369994 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cbc66-b75c-422b-bcca-5552b1890c1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:55.373317 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:55.378748 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cbc66-b75c-422b-bcca-5552b1890c1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:55.380468 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cbc66-b75c-422b-bcca-5552b1890c1f None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-3d7cbc66-b75c-422b-bcca-5552b1890c1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:37:55.396636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:55.398214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:37:55.399422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 439/860] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:55.406457 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6c366-ef72-4bbd-8166-68ea235873e9 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:55.521702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6c366-ef72-4bbd-8166-68ea235873e9 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:55.562578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3650b-cc46-442c-81f7-ab8010445643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:55.563446 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3650b-cc46-442c-81f7-ab8010445643 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:55.563847 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3650b-cc46-442c-81f7-ab8010445643 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:55.564143 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3650b-cc46-442c-81f7-ab8010445643 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:55.565158 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3650b-cc46-442c-81f7-ab8010445643 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:55.565472 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3650b-cc46-442c-81f7-ab8010445643 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:55.566976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3650b-cc46-442c-81f7-ab8010445643 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:55.587864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 422/861] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Jun 25 20:37:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:55.593021 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cbc66-b75c-422b-bcca-5552b1890c1f None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:55.718061 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cbc66-b75c-422b-bcca-5552b1890c1f None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:55.757531 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053085-5877-4e4c-88d5-4baae2e32847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:55.758170 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053085-5877-4e4c-88d5-4baae2e32847 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:55.758489 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053085-5877-4e4c-88d5-4baae2e32847 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:55.758771 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32053085-5877-4e4c-88d5-4baae2e32847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:55.824709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:55.832274 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32053085-5877-4e4c-88d5-4baae2e32847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:55.833853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32053085-5877-4e4c-88d5-4baae2e32847 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:55.957452 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 440/862] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:37:55 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:37:55.963793 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3650b-cc46-442c-81f7-ab8010445643 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:55.991150 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:56.074181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3650b-cc46-442c-81f7-ab8010445643 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:56.111901 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a4f29-2ffb-4057-9e22-5f0c64074b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:56.112669 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a4f29-2ffb-4057-9e22-5f0c64074b17 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:56.112948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a4f29-2ffb-4057-9e22-5f0c64074b17 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:56.113220 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a4f29-2ffb-4057-9e22-5f0c64074b17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:56.124189 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a4f29-2ffb-4057-9e22-5f0c64074b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:56.125657 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764a4f29-2ffb-4057-9e22-5f0c64074b17 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-764a4f29-2ffb-4057-9e22-5f0c64074b17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:37:56.143436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:56.144579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:56.145739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:37:56.145739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:37:56.145739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:37:56.145739 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:56.150082 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 423/863] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:56.151170 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053085-5877-4e4c-88d5-4baae2e32847 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:56.268818 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:56.275646 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32053085-5877-4e4c-88d5-4baae2e32847 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:56.315298 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25abfef-0816-41f3-979c-1476a5620b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:56.316002 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abfef-0816-41f3-979c-1476a5620b12 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:56.316296 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abfef-0816-41f3-979c-1476a5620b12 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:56.316657 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25abfef-0816-41f3-979c-1476a5620b12 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:56.317575 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25abfef-0816-41f3-979c-1476a5620b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:56.317904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25abfef-0816-41f3-979c-1476a5620b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:56.319558 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25abfef-0816-41f3-979c-1476a5620b12 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:56.332597 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 441/864] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:56.338529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a4f29-2ffb-4057-9e22-5f0c64074b17 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:56.416067 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:56.442239 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a4f29-2ffb-4057-9e22-5f0c64074b17 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:56.481637 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01428-50f4-4fef-b679-94ee244c3e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:56.482476 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01428-50f4-4fef-b679-94ee244c3e8b None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:56.482766 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01428-50f4-4fef-b679-94ee244c3e8b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:56.483041 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc01428-50f4-4fef-b679-94ee244c3e8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:56.490693 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01428-50f4-4fef-b679-94ee244c3e8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:56.492202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc01428-50f4-4fef-b679-94ee244c3e8b None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-adc01428-50f4-4fef-b679-94ee244c3e8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:37:56.507454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:56.508454 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:56.509414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:37:56.509414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:37:56.509414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:37:56.509414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:37:56.509414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:37:56.509414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:37:56.509414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:37:56.509414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:37:56.514470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 424/865] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:37:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:56.516791 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25abfef-0816-41f3-979c-1476a5620b12 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:56.640173 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25abfef-0816-41f3-979c-1476a5620b12 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:56.679482 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bcb78-0f1d-4a6b-837e-47213822e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:56.680136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bcb78-0f1d-4a6b-837e-47213822e0db None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:56.680597 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bcb78-0f1d-4a6b-837e-47213822e0db None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:56.680828 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bcb78-0f1d-4a6b-837e-47213822e0db None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:56.681726 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bcb78-0f1d-4a6b-837e-47213822e0db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:56.682275 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bcb78-0f1d-4a6b-837e-47213822e0db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:56.683624 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bcb78-0f1d-4a6b-837e-47213822e0db None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:56.698278 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 442/866] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:56.704512 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01428-50f4-4fef-b679-94ee244c3e8b None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:56.821909 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc01428-50f4-4fef-b679-94ee244c3e8b None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:56.859753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cf3fc-09b6-414b-ae08-032ee747d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:56.860446 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cf3fc-09b6-414b-ae08-032ee747d101 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:56.860699 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cf3fc-09b6-414b-ae08-032ee747d101 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:56.860976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cf3fc-09b6-414b-ae08-032ee747d101 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:56.861880 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cf3fc-09b6-414b-ae08-032ee747d101 None admin] RBAC: Adding query filter params (role.id=04404f6921a84a09bb039aaea888fca8, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=d91c64b1ed4e49c7870ac00844b29bb4) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:56.862189 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cf3fc-09b6-414b-ae08-032ee747d101 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:56.863724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cf3fc-09b6-414b-ae08-032ee747d101 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:56.866803 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:56.871131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 425/867] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:37:56 2022] GET /identity/v3/role_assignments?user.id=d91c64b1ed4e49c7870ac00844b29bb4&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=04404f6921a84a09bb039aaea888fca8 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:37:59.422088 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64741-8d34-4989-aa78-158cefe4bda5 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:59.422710 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64741-8d34-4989-aa78-158cefe4bda5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:59.422812 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64741-8d34-4989-aa78-158cefe4bda5 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:59.424292 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 443/868] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:37:59.431459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15728702-1c95-4c30-8474-125e879a5ca9 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:59.431988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15728702-1c95-4c30-8474-125e879a5ca9 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:59.431988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15728702-1c95-4c30-8474-125e879a5ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:59.450099 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-15728702-1c95-4c30-8474-125e879a5ca9 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:37:59.451371 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-15728702-1c95-4c30-8474-125e879a5ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:37:59.522094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 426/869] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:37:59 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:37:59.547700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64741-8d34-4989-aa78-158cefe4bda5 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:59.567903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:59.671933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64741-8d34-4989-aa78-158cefe4bda5 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:59.707705 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc515f-e27a-47a1-a9bc-d550a61f2d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:59.708530 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc515f-e27a-47a1-a9bc-d550a61f2d53 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:59.708870 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc515f-e27a-47a1-a9bc-d550a61f2d53 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:59.709194 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc515f-e27a-47a1-a9bc-d550a61f2d53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:59.720275 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc515f-e27a-47a1-a9bc-d550a61f2d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-93dc515f-e27a-47a1-a9bc-d550a61f2d53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:37:59.728222 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:37:59.729359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:37:59.735177 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 444/870] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:37:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:37:59.736083 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15728702-1c95-4c30-8474-125e879a5ca9 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:59.841503 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15728702-1c95-4c30-8474-125e879a5ca9 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:37:59.868622 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:37:59.877104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49917e33-49f4-4752-8207-643b0e1cd801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:37:59.877777 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49917e33-49f4-4752-8207-643b0e1cd801 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:37:59.878064 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49917e33-49f4-4752-8207-643b0e1cd801 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:37:59.878347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49917e33-49f4-4752-8207-643b0e1cd801 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:37:59.879133 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49917e33-49f4-4752-8207-643b0e1cd801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:37:59.879444 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49917e33-49f4-4752-8207-643b0e1cd801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:37:59.880828 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49917e33-49f4-4752-8207-643b0e1cd801 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:37:59.889410 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 427/871] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:37:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:37:59.895393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc515f-e27a-47a1-a9bc-d550a61f2d53 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:37:59.983670 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:00.010284 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc515f-e27a-47a1-a9bc-d550a61f2d53 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:00.044139 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702e7b1-be39-4b45-8437-a4a2b418a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:00.044938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702e7b1-be39-4b45-8437-a4a2b418a1ab None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:00.045223 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702e7b1-be39-4b45-8437-a4a2b418a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:00.045498 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702e7b1-be39-4b45-8437-a4a2b418a1ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:00.056441 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702e7b1-be39-4b45-8437-a4a2b418a1ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:00.057922 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702e7b1-be39-4b45-8437-a4a2b418a1ab None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-1702e7b1-be39-4b45-8437-a4a2b418a1ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:38:00.075269 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:00.076355 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:00.077358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:38:00.077358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:38:00.077358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:00.077358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:38:00.077358 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 445/872] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:00.082534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49917e33-49f4-4752-8207-643b0e1cd801 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:00.183812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49917e33-49f4-4752-8207-643b0e1cd801 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:00.217938 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1d56c-e5f4-41c9-bc39-91afba5962b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:00.218677 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1d56c-e5f4-41c9-bc39-91afba5962b1 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:00.218898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1d56c-e5f4-41c9-bc39-91afba5962b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:00.219178 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1d56c-e5f4-41c9-bc39-91afba5962b1 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:00.219906 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1d56c-e5f4-41c9-bc39-91afba5962b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:00.220248 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1d56c-e5f4-41c9-bc39-91afba5962b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:00.221592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1d56c-e5f4-41c9-bc39-91afba5962b1 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:00.234843 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 428/873] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:38:00.240776 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702e7b1-be39-4b45-8437-a4a2b418a1ab None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:00.351344 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702e7b1-be39-4b45-8437-a4a2b418a1ab None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:00.378378 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:00.387663 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34befb3d-b883-4a81-8db7-6cd49ecc690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:00.388471 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34befb3d-b883-4a81-8db7-6cd49ecc690e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:00.388712 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34befb3d-b883-4a81-8db7-6cd49ecc690e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:00.388988 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34befb3d-b883-4a81-8db7-6cd49ecc690e None admin] PATH_INFO: `/v3/users/placement` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:00.397149 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34befb3d-b883-4a81-8db7-6cd49ecc690e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:00.398652 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34befb3d-b883-4a81-8db7-6cd49ecc690e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-34befb3d-b883-4a81-8db7-6cd49ecc690e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:38:00.413105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:00.414337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:38:00.415360 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 446/874] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:38:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:00.420257 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1d56c-e5f4-41c9-bc39-91afba5962b1 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:00.474816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:00.528203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1d56c-e5f4-41c9-bc39-91afba5962b1 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:00.564408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434878b6-88a5-4acc-ba0c-a4343f60da36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:00.565102 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434878b6-88a5-4acc-ba0c-a4343f60da36 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:00.565399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434878b6-88a5-4acc-ba0c-a4343f60da36 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:00.565658 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434878b6-88a5-4acc-ba0c-a4343f60da36 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:00.566515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434878b6-88a5-4acc-ba0c-a4343f60da36 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:00.566825 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434878b6-88a5-4acc-ba0c-a4343f60da36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:00.568278 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434878b6-88a5-4acc-ba0c-a4343f60da36 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:00.586409 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 429/875] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Jun 25 20:38:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:00.592915 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34befb3d-b883-4a81-8db7-6cd49ecc690e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:00.704576 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34befb3d-b883-4a81-8db7-6cd49ecc690e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:00.740512 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648166d9-61ed-4cc1-8e8b-f0a6d3249d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:00.741199 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648166d9-61ed-4cc1-8e8b-f0a6d3249d5d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:00.741486 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648166d9-61ed-4cc1-8e8b-f0a6d3249d5d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:00.741807 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648166d9-61ed-4cc1-8e8b-f0a6d3249d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:00.821525 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:00.835069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648166d9-61ed-4cc1-8e8b-f0a6d3249d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:00.836833 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648166d9-61ed-4cc1-8e8b-f0a6d3249d5d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:00.960811 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 447/876] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:38:00 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:38:00.967489 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434878b6-88a5-4acc-ba0c-a4343f60da36 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:01.084716 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434878b6-88a5-4acc-ba0c-a4343f60da36 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:01.096676 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:01.124063 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ad46f-b047-4625-a789-645a8fd785e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:01.124875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ad46f-b047-4625-a789-645a8fd785e1 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:01.125160 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ad46f-b047-4625-a789-645a8fd785e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:01.125439 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ad46f-b047-4625-a789-645a8fd785e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:01.138895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ad46f-b047-4625-a789-645a8fd785e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:01.140417 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ad46f-b047-4625-a789-645a8fd785e1 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-953ad46f-b047-4625-a789-645a8fd785e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:38:01.161800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:01.162860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:01.163990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:38:01.163990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:38:01.163990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:01.163990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:01.163990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 430/877] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:01.170084 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648166d9-61ed-4cc1-8e8b-f0a6d3249d5d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:01.267738 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:01.281707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648166d9-61ed-4cc1-8e8b-f0a6d3249d5d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:01.319293 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8836a1-283d-454f-8d9f-df1a75aab0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:01.319973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8836a1-283d-454f-8d9f-df1a75aab0cc None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:01.320253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8836a1-283d-454f-8d9f-df1a75aab0cc None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:01.320509 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8836a1-283d-454f-8d9f-df1a75aab0cc None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:01.321237 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8836a1-283d-454f-8d9f-df1a75aab0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:01.321602 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8836a1-283d-454f-8d9f-df1a75aab0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:01.323043 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8836a1-283d-454f-8d9f-df1a75aab0cc None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:01.335443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 448/878] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:01.341799 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ad46f-b047-4625-a789-645a8fd785e1 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:01.446480 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ad46f-b047-4625-a789-645a8fd785e1 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:01.482798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e7a3a-4318-4a5a-8dbb-68ca00d0921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:01.483607 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e7a3a-4318-4a5a-8dbb-68ca00d0921b None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:01.483895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e7a3a-4318-4a5a-8dbb-68ca00d0921b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:01.484174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e7a3a-4318-4a5a-8dbb-68ca00d0921b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:01.493648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e7a3a-4318-4a5a-8dbb-68ca00d0921b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:01.495169 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e7a3a-4318-4a5a-8dbb-68ca00d0921b None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-b86e7a3a-4318-4a5a-8dbb-68ca00d0921b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:38:01.509857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:01.510857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:01.511975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:38:01.511975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:38:01.511975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:38:01.511975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:38:01.511975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:38:01.511975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:38:01.511975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:38:01.511975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:01.511975 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 431/879] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:01.517055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8836a1-283d-454f-8d9f-df1a75aab0cc None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:01.624442 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8836a1-283d-454f-8d9f-df1a75aab0cc None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:01.662977 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5acd04-f205-460b-8aa8-14ab75e22828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:01.663920 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5acd04-f205-460b-8aa8-14ab75e22828 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:01.664310 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5acd04-f205-460b-8aa8-14ab75e22828 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:01.664630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5acd04-f205-460b-8aa8-14ab75e22828 None admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:01.665800 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5acd04-f205-460b-8aa8-14ab75e22828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:01.666235 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5acd04-f205-460b-8aa8-14ab75e22828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:01.667902 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5acd04-f205-460b-8aa8-14ab75e22828 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:01.681802 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 449/880] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:01.693637 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e7a3a-4318-4a5a-8dbb-68ca00d0921b None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:01.724659 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:01.812652 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e7a3a-4318-4a5a-8dbb-68ca00d0921b None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:01.848604 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65640fe0-0d39-444d-90a3-0041b98670b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:01.849246 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640fe0-0d39-444d-90a3-0041b98670b2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:01.849530 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640fe0-0d39-444d-90a3-0041b98670b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:01.849807 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640fe0-0d39-444d-90a3-0041b98670b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:01.850665 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640fe0-0d39-444d-90a3-0041b98670b2 None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=d91c64b1ed4e49c7870ac00844b29bb4) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:01.850977 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640fe0-0d39-444d-90a3-0041b98670b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:01.852425 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640fe0-0d39-444d-90a3-0041b98670b2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:01.857961 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 432/881] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:38:01 2022] GET /identity/v3/role_assignments?user.id=d91c64b1ed4e49c7870ac00844b29bb4&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=8e22816a513845d88f4934c2164a142b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:04.112144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af964-0a29-4303-b6eb-fe726be0f68f None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.113036 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af964-0a29-4303-b6eb-fe726be0f68f None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.113036 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512af964-0a29-4303-b6eb-fe726be0f68f None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.115287 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 450/882] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:38:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:04.120790 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe9a0-7ac6-446c-a9a7-0d2fe3f9d152 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.121220 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe9a0-7ac6-446c-a9a7-0d2fe3f9d152 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.121311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbe9a0-7ac6-446c-a9a7-0d2fe3f9d152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.140099 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-3cfbe9a0-7ac6-446c-a9a7-0d2fe3f9d152 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:04.141308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-3cfbe9a0-7ac6-446c-a9a7-0d2fe3f9d152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:04.212487 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 433/883] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:04 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:04.236581 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af964-0a29-4303-b6eb-fe726be0f68f None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:04.249111 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:04.348726 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512af964-0a29-4303-b6eb-fe726be0f68f None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:04.387888 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608110d-4646-4292-82df-0cce970981b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:04.388681 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608110d-4646-4292-82df-0cce970981b5 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.388964 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608110d-4646-4292-82df-0cce970981b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.389236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608110d-4646-4292-82df-0cce970981b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.400331 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608110d-4646-4292-82df-0cce970981b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e608110d-4646-4292-82df-0cce970981b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:38:04.407897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:04.408972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:38:04.409939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 451/884] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:04.415355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe9a0-7ac6-446c-a9a7-0d2fe3f9d152 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:04.431602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:04.521322 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfbe9a0-7ac6-446c-a9a7-0d2fe3f9d152 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:04.557021 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c10ba5-d936-40c9-b0ac-9fc80cebf8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:04.557683 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c10ba5-d936-40c9-b0ac-9fc80cebf8a9 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.557971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c10ba5-d936-40c9-b0ac-9fc80cebf8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.558244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c10ba5-d936-40c9-b0ac-9fc80cebf8a9 None admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.559029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c10ba5-d936-40c9-b0ac-9fc80cebf8a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:04.559336 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c10ba5-d936-40c9-b0ac-9fc80cebf8a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:04.560766 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c10ba5-d936-40c9-b0ac-9fc80cebf8a9 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:04.569602 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 434/885] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:38:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:04.576081 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608110d-4646-4292-82df-0cce970981b5 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:04.648318 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:04.686808 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608110d-4646-4292-82df-0cce970981b5 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:04.722268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9efc6-33be-4e59-9b7e-272f3299ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:04.723087 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9efc6-33be-4e59-9b7e-272f3299ce89 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.723375 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9efc6-33be-4e59-9b7e-272f3299ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.723651 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9efc6-33be-4e59-9b7e-272f3299ce89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.735628 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9efc6-33be-4e59-9b7e-272f3299ce89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:04.737136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9efc6-33be-4e59-9b7e-272f3299ce89 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-e8b9efc6-33be-4e59-9b7e-272f3299ce89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:38:04.754211 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:04.755145 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:04.756208 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:38:04.756208 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:38:04.756208 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:04.756208 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:38:04.756208 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 452/886] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:04.761610 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c10ba5-d936-40c9-b0ac-9fc80cebf8a9 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:04.849443 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:04.874436 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c10ba5-d936-40c9-b0ac-9fc80cebf8a9 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:04.912465 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a40fa2-31a3-4ac8-a926-752a352564bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:04.913114 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a40fa2-31a3-4ac8-a926-752a352564bc None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:04.913397 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a40fa2-31a3-4ac8-a926-752a352564bc None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:04.913668 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a40fa2-31a3-4ac8-a926-752a352564bc None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:04.914386 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a40fa2-31a3-4ac8-a926-752a352564bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:04.914729 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a40fa2-31a3-4ac8-a926-752a352564bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:04.916157 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a40fa2-31a3-4ac8-a926-752a352564bc None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:04.931133 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 435/887] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:38:04.937052 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9efc6-33be-4e59-9b7e-272f3299ce89 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:05.046596 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9efc6-33be-4e59-9b7e-272f3299ce89 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:05.067109 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:05.083430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25af66c-50fe-4b17-902c-b8907215bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:05.084233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25af66c-50fe-4b17-902c-b8907215bb8e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:05.084516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25af66c-50fe-4b17-902c-b8907215bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:05.084791 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25af66c-50fe-4b17-902c-b8907215bb8e None admin] PATH_INFO: `/v3/users/placement` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:05.093232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25af66c-50fe-4b17-902c-b8907215bb8e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:05.094772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25af66c-50fe-4b17-902c-b8907215bb8e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-d25af66c-50fe-4b17-902c-b8907215bb8e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:38:05.109723 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:05.110704 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:38:05.111826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 453/888] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:38:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:05.117979 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a40fa2-31a3-4ac8-a926-752a352564bc None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:05.232612 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a40fa2-31a3-4ac8-a926-752a352564bc None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:05.268183 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060b621-1ef0-4c96-a10f-fc0d491262a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:05.268839 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060b621-1ef0-4c96-a10f-fc0d491262a0 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:05.269097 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060b621-1ef0-4c96-a10f-fc0d491262a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:05.269372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060b621-1ef0-4c96-a10f-fc0d491262a0 None admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:05.270227 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060b621-1ef0-4c96-a10f-fc0d491262a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:05.270570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060b621-1ef0-4c96-a10f-fc0d491262a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:05.272006 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060b621-1ef0-4c96-a10f-fc0d491262a0 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:05.274624 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:05.289434 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 436/889] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Jun 25 20:38:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:05.295424 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25af66c-50fe-4b17-902c-b8907215bb8e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:05.396560 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25af66c-50fe-4b17-902c-b8907215bb8e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:05.433367 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06129b3d-b087-458d-aa87-f7ccdf08e34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:05.434142 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06129b3d-b087-458d-aa87-f7ccdf08e34e None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:05.434454 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06129b3d-b087-458d-aa87-f7ccdf08e34e None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:05.434733 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06129b3d-b087-458d-aa87-f7ccdf08e34e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:05.445806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06129b3d-b087-458d-aa87-f7ccdf08e34e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:05.447430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06129b3d-b087-458d-aa87-f7ccdf08e34e None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-06129b3d-b087-458d-aa87-f7ccdf08e34e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:38:05.465053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:05.466385 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:05.467592 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:38:05.467592 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:38:05.467592 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:05.467592 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:38:05.467592 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 454/890] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:05.474790 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060b621-1ef0-4c96-a10f-fc0d491262a0 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:05.594215 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060b621-1ef0-4c96-a10f-fc0d491262a0 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:05.635684 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a44f9-a8a1-4f5c-b615-90a6ac0f5906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:05.636453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a44f9-a8a1-4f5c-b615-90a6ac0f5906 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:05.636732 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a44f9-a8a1-4f5c-b615-90a6ac0f5906 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:05.637129 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a44f9-a8a1-4f5c-b615-90a6ac0f5906 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:05.637879 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a44f9-a8a1-4f5c-b615-90a6ac0f5906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:05.638189 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a44f9-a8a1-4f5c-b615-90a6ac0f5906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:05.639706 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a44f9-a8a1-4f5c-b615-90a6ac0f5906 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:05.653745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 437/891] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:05.659508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06129b3d-b087-458d-aa87-f7ccdf08e34e None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:05.693793 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:05.765579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06129b3d-b087-458d-aa87-f7ccdf08e34e None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:05.803245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34b798-eec5-4736-8387-d0777a84956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:05.804040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34b798-eec5-4736-8387-d0777a84956d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:05.804334 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34b798-eec5-4736-8387-d0777a84956d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:05.804609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34b798-eec5-4736-8387-d0777a84956d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:05.812407 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34b798-eec5-4736-8387-d0777a84956d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:05.813873 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34b798-eec5-4736-8387-d0777a84956d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-3b34b798-eec5-4736-8387-d0777a84956d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:38:05.829034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:05.829998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:05.831364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:38:05.831364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:38:05.831364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:38:05.831364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:38:05.831364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:38:05.831364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:38:05.831364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:38:05.831364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:38:05.831364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 455/892] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:05.839283 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a44f9-a8a1-4f5c-b615-90a6ac0f5906 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:05.909738 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:05.959176 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a44f9-a8a1-4f5c-b615-90a6ac0f5906 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:06.007947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f564405-2ad7-4bf7-8958-7fe766451f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:06.009007 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f564405-2ad7-4bf7-8958-7fe766451f2f None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:06.009567 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f564405-2ad7-4bf7-8958-7fe766451f2f None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:06.009854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f564405-2ad7-4bf7-8958-7fe766451f2f None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:06.010712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f564405-2ad7-4bf7-8958-7fe766451f2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:06.011031 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f564405-2ad7-4bf7-8958-7fe766451f2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:06.012492 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f564405-2ad7-4bf7-8958-7fe766451f2f None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:06.026631 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 438/893] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:06.032865 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34b798-eec5-4736-8387-d0777a84956d None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:06.138224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:06.150764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34b798-eec5-4736-8387-d0777a84956d None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:06.190525 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b925cc-965c-4acb-b945-438654616d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:06.191813 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b925cc-965c-4acb-b945-438654616d72 None admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:06.192225 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b925cc-965c-4acb-b945-438654616d72 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:06.192637 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b925cc-965c-4acb-b945-438654616d72 None admin] PATH_INFO: `/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/d91c64b1ed4e49c7870ac00844b29bb4/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:06.196122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b925cc-965c-4acb-b945-438654616d72 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad8cd680e7d47a7a966e6f82e56ec87, user_id=d91c64b1ed4e49c7870ac00844b29bb4, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:06.198586 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b925cc-965c-4acb-b945-438654616d72 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:06.218531 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 456/894] 10.222.0.26 () {58 vars in 1439 bytes} [Sat Jun 25 20:38:06 2022] PUT /identity/v3/projects/3ad8cd680e7d47a7a966e6f82e56ec87/users/d91c64b1ed4e49c7870ac00844b29bb4/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:38:08.500219 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3e30-0f4a-4e28-9f05-2f6be6364ed8 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:08.500790 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3e30-0f4a-4e28-9f05-2f6be6364ed8 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:08.500790 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb3e30-0f4a-4e28-9f05-2f6be6364ed8 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:08.502169 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 439/895] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:38:08.508533 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346cb23-a247-4763-a446-fce4abb541a4 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:08.509332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346cb23-a247-4763-a446-fce4abb541a4 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:08.509522 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346cb23-a247-4763-a446-fce4abb541a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:08.532895 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-6346cb23-a247-4763-a446-fce4abb541a4 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:08.534081 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-6346cb23-a247-4763-a446-fce4abb541a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:08.605852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 457/896] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:08 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:08.638852 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb3e30-0f4a-4e28-9f05-2f6be6364ed8 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:08.753608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb3e30-0f4a-4e28-9f05-2f6be6364ed8 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:08.769086 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:08.799267 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83df70-c29b-4e4b-9476-b9e11e8c0f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:08.800059 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83df70-c29b-4e4b-9476-b9e11e8c0f65 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:08.800350 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83df70-c29b-4e4b-9476-b9e11e8c0f65 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:08.800629 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd83df70-c29b-4e4b-9476-b9e11e8c0f65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:08.811709 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd83df70-c29b-4e4b-9476-b9e11e8c0f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-dd83df70-c29b-4e4b-9476-b9e11e8c0f65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 25 20:38:08.820258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:08.821394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:08.822764 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 440/897] 10.222.0.26 () {56 vars in 1096 bytes} [Sat Jun 25 20:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:08.827800 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346cb23-a247-4763-a446-fce4abb541a4 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:08.913831 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:08.944928 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346cb23-a247-4763-a446-fce4abb541a4 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:08.985541 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2a21c-c24c-477a-b11f-62aed1c9065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:08.986216 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2a21c-c24c-477a-b11f-62aed1c9065b None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:08.986536 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2a21c-c24c-477a-b11f-62aed1c9065b None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:08.986814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2a21c-c24c-477a-b11f-62aed1c9065b None admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:08.987562 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2a21c-c24c-477a-b11f-62aed1c9065b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:08.987870 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2a21c-c24c-477a-b11f-62aed1c9065b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:08.989251 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2a21c-c24c-477a-b11f-62aed1c9065b None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:08.998035 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 458/898] 10.222.0.26 () {56 vars in 1099 bytes} [Sat Jun 25 20:38:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:09.006807 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83df70-c29b-4e4b-9476-b9e11e8c0f65 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:09.114296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd83df70-c29b-4e4b-9476-b9e11e8c0f65 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:09.149636 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecf433-e1db-4f7b-95c9-1738b58126a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:09.150463 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecf433-e1db-4f7b-95c9-1738b58126a2 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:09.150779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecf433-e1db-4f7b-95c9-1738b58126a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:09.151057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecf433-e1db-4f7b-95c9-1738b58126a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:09.162930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecf433-e1db-4f7b-95c9-1738b58126a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:09.164413 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecf433-e1db-4f7b-95c9-1738b58126a2 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-97ecf433-e1db-4f7b-95c9-1738b58126a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:38:09.182048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:09.183100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:09.184002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:38:09.184002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:38:09.184002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:09.184002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:09.184002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 441/899] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 25 20:38:09.189677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2a21c-c24c-477a-b11f-62aed1c9065b None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:09.302823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2a21c-c24c-477a-b11f-62aed1c9065b None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:09.338801 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a6f1-c495-411d-a4d6-bb0399d18e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:09.339453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a6f1-c495-411d-a4d6-bb0399d18e41 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:09.339739 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a6f1-c495-411d-a4d6-bb0399d18e41 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:09.340015 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a6f1-c495-411d-a4d6-bb0399d18e41 None admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:09.340768 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a6f1-c495-411d-a4d6-bb0399d18e41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:09.341056 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a6f1-c495-411d-a4d6-bb0399d18e41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:09.342826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a6f1-c495-411d-a4d6-bb0399d18e41 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:09.354866 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 459/900] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:09.363546 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecf433-e1db-4f7b-95c9-1738b58126a2 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:09.396013 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:09.478308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecf433-e1db-4f7b-95c9-1738b58126a2 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:09.514166 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df44e-b19e-45cb-a467-759929f66e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:09.514984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df44e-b19e-45cb-a467-759929f66e70 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:09.515269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df44e-b19e-45cb-a467-759929f66e70 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:09.515546 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df44e-b19e-45cb-a467-759929f66e70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:09.523296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852df44e-b19e-45cb-a467-759929f66e70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:09.524745 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852df44e-b19e-45cb-a467-759929f66e70 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-852df44e-b19e-45cb-a467-759929f66e70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 25 20:38:09.538874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:09.539933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 25 20:38:09.541198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:09.542607 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 442/901] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:38:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:09.545865 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a6f1-c495-411d-a4d6-bb0399d18e41 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:09.549843 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:09.659892 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a6f1-c495-411d-a4d6-bb0399d18e41 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:09.703564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c1a8b-5680-415d-8789-d303aff3db69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:09.704230 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1a8b-5680-415d-8789-d303aff3db69 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:09.704511 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1a8b-5680-415d-8789-d303aff3db69 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:09.704786 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1a8b-5680-415d-8789-d303aff3db69 None admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:09.705612 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c1a8b-5680-415d-8789-d303aff3db69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:09.705924 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c1a8b-5680-415d-8789-d303aff3db69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:09.707393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c1a8b-5680-415d-8789-d303aff3db69 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:09.724716 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 460/902] 10.222.0.26 () {56 vars in 1143 bytes} [Sat Jun 25 20:38:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:09.731553 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df44e-b19e-45cb-a467-759929f66e70 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:09.833965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:09.849708 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df44e-b19e-45cb-a467-759929f66e70 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:09.892779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2a49c-da48-4057-8a36-5422d4a42fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:09.893688 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2a49c-da48-4057-8a36-5422d4a42fd8 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:09.894079 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2a49c-da48-4057-8a36-5422d4a42fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:09.894492 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2a49c-da48-4057-8a36-5422d4a42fd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:09.977609 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2a49c-da48-4057-8a36-5422d4a42fd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:09.979214 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2a49c-da48-4057-8a36-5422d4a42fd8 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:10.080480 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:10.098989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 443/903] 10.222.0.26 () {58 vars in 1282 bytes} [Sat Jun 25 20:38:09 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 25 20:38:10.105363 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c1a8b-5680-415d-8789-d303aff3db69 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:10.172024 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:10.212720 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c1a8b-5680-415d-8789-d303aff3db69 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:10.247705 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1684e1-81c2-4eb8-adec-840d928f06f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:10.248484 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1684e1-81c2-4eb8-adec-840d928f06f2 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:10.248775 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1684e1-81c2-4eb8-adec-840d928f06f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:10.249046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1684e1-81c2-4eb8-adec-840d928f06f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:10.259541 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1684e1-81c2-4eb8-adec-840d928f06f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:10.261041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1684e1-81c2-4eb8-adec-840d928f06f2 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-2b1684e1-81c2-4eb8-adec-840d928f06f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 25 20:38:10.279574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:10.280556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:10.281867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 25 20:38:10.281867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 25 20:38:10.281867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 25 20:38:10.281867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:38:10.281867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 461/904] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:10.286722 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2a49c-da48-4057-8a36-5422d4a42fd8 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:10.396360 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2a49c-da48-4057-8a36-5422d4a42fd8 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:10.433072 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2358015-8d8d-4222-b848-c80849261438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:10.433710 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2358015-8d8d-4222-b848-c80849261438 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:10.433989 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2358015-8d8d-4222-b848-c80849261438 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:10.434263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2358015-8d8d-4222-b848-c80849261438 None admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:10.435008 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2358015-8d8d-4222-b848-c80849261438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:10.435313 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2358015-8d8d-4222-b848-c80849261438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:10.436690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2358015-8d8d-4222-b848-c80849261438 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:10.448017 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 444/905] 10.222.0.26 () {56 vars in 1109 bytes} [Sat Jun 25 20:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:38:10.453785 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1684e1-81c2-4eb8-adec-840d928f06f2 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:10.566121 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1684e1-81c2-4eb8-adec-840d928f06f2 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:10.580852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:10.604233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65d72a-abc9-4616-af71-7edfde2c7c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:10.605020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65d72a-abc9-4616-af71-7edfde2c7c33 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:10.605297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65d72a-abc9-4616-af71-7edfde2c7c33 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:10.605567 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65d72a-abc9-4616-af71-7edfde2c7c33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:10.613268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65d72a-abc9-4616-af71-7edfde2c7c33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:10.614911 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f65d72a-abc9-4616-af71-7edfde2c7c33 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application [None req-7f65d72a-abc9-4616-af71-7edfde2c7c33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 25 20:38:10.629823 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:10.630887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:10.631764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 25 20:38:10.631764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 25 20:38:10.631764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 25 20:38:10.631764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 25 20:38:10.631764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 25 20:38:10.631764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 25 20:38:10.631764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 25 20:38:10.631764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: ERROR keystone.server.flask.application Jun 25 20:38:10.631764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 462/906] 10.222.0.26 () {56 vars in 1111 bytes} [Sat Jun 25 20:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:10.638338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2358015-8d8d-4222-b848-c80849261438 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:10.686226 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:10.745065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2358015-8d8d-4222-b848-c80849261438 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:10.784959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553391bf-2ddd-4722-bd8a-940efcc284b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:10.785608 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553391bf-2ddd-4722-bd8a-940efcc284b6 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:10.785891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553391bf-2ddd-4722-bd8a-940efcc284b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:10.786168 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553391bf-2ddd-4722-bd8a-940efcc284b6 None admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:10.786993 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553391bf-2ddd-4722-bd8a-940efcc284b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:10.787302 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553391bf-2ddd-4722-bd8a-940efcc284b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:10.788756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553391bf-2ddd-4722-bd8a-940efcc284b6 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:10.801088 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 445/907] 10.222.0.26 () {56 vars in 1148 bytes} [Sat Jun 25 20:38:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:38:10.807547 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65d72a-abc9-4616-af71-7edfde2c7c33 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:10.914962 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f65d72a-abc9-4616-af71-7edfde2c7c33 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:10.958986 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c34aa6-ec65-4f5a-9537-9624e28f8323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:10.959639 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c34aa6-ec65-4f5a-9537-9624e28f8323 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:10.959919 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c34aa6-ec65-4f5a-9537-9624e28f8323 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:10.960195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c34aa6-ec65-4f5a-9537-9624e28f8323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:10.961028 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c34aa6-ec65-4f5a-9537-9624e28f8323 None admin] RBAC: Adding query filter params (role.id=8e22816a513845d88f4934c2164a142b, scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87, user.id=d91c64b1ed4e49c7870ac00844b29bb4) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:10.961367 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c34aa6-ec65-4f5a-9537-9624e28f8323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:10.963029 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c34aa6-ec65-4f5a-9537-9624e28f8323 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:10.969469 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 463/908] 10.222.0.26 () {56 vars in 1374 bytes} [Sat Jun 25 20:38:10 2022] GET /identity/v3/role_assignments?user.id=d91c64b1ed4e49c7870ac00844b29bb4&scope.project.id=3ad8cd680e7d47a7a966e6f82e56ec87&role.id=8e22816a513845d88f4934c2164a142b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:13.253112 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b8b07-71f1-44ff-849d-ae0db5eb8ec7 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:13.253948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b8b07-71f1-44ff-849d-ae0db5eb8ec7 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:13.253948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b8b07-71f1-44ff-849d-ae0db5eb8ec7 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:13.256375 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 446/909] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:13.265647 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748b248-9678-47b0-8643-40c5a2233ddc None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:13.266389 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748b248-9678-47b0-8643-40c5a2233ddc None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:13.266539 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748b248-9678-47b0-8643-40c5a2233ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:13.293525 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-d748b248-9678-47b0-8643-40c5a2233ddc None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:13.294750 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-d748b248-9678-47b0-8643-40c5a2233ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:13.326212 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:13.375152 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 464/910] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:13 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:13.398898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b8b07-71f1-44ff-849d-ae0db5eb8ec7 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:13.509864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b8b07-71f1-44ff-849d-ae0db5eb8ec7 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:13.517511 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:13.546580 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda58fe-7d6c-4e03-8369-3be86667b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:13.547355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda58fe-7d6c-4e03-8369-3be86667b020 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:13.547638 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda58fe-7d6c-4e03-8369-3be86667b020 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:13.547921 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda58fe-7d6c-4e03-8369-3be86667b020 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:13.548577 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda58fe-7d6c-4e03-8369-3be86667b020 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:13.549969 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda58fe-7d6c-4e03-8369-3be86667b020 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-ecda58fe-7d6c-4e03-8369-3be86667b020 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:13.562650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:13.563781 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:13.564988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 447/911] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Jun 25 20:38:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:13.570479 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748b248-9678-47b0-8643-40c5a2233ddc None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:13.687501 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748b248-9678-47b0-8643-40c5a2233ddc None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:13.723707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9df3eb-b10d-4ce8-ab3f-d1706d3044c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:13.724369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9df3eb-b10d-4ce8-ab3f-d1706d3044c9 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:13.724651 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9df3eb-b10d-4ce8-ab3f-d1706d3044c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:13.724922 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9df3eb-b10d-4ce8-ab3f-d1706d3044c9 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:13.725620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9df3eb-b10d-4ce8-ab3f-d1706d3044c9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:13.725924 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9df3eb-b10d-4ce8-ab3f-d1706d3044c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:13.727333 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9df3eb-b10d-4ce8-ab3f-d1706d3044c9 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:13.731973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 465/912] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Jun 25 20:38:13 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:13.737885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda58fe-7d6c-4e03-8369-3be86667b020 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:13.841860 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda58fe-7d6c-4e03-8369-3be86667b020 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:13.876196 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a5383-a81d-4037-8f09-214874ea48fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:13.876820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a5383-a81d-4037-8f09-214874ea48fc None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:13.877133 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a5383-a81d-4037-8f09-214874ea48fc None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:13.877403 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a5383-a81d-4037-8f09-214874ea48fc None admin] PATH_INFO: `/v3/services` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:13.878100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a5383-a81d-4037-8f09-214874ea48fc None admin] RBAC: Adding query filter params (type=placement) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:13.878407 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a5383-a81d-4037-8f09-214874ea48fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:13.879819 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a5383-a81d-4037-8f09-214874ea48fc None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:13.884410 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 448/913] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Jun 25 20:38:13 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:16.119563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5140da-f2a1-43a4-80a0-b6aa893c923d None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:16.120146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5140da-f2a1-43a4-80a0-b6aa893c923d None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:16.120146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5140da-f2a1-43a4-80a0-b6aa893c923d None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:16.121627 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 466/914] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:16.127956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774b53f-304f-411f-9ae6-9e9b9e679334 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:16.128618 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774b53f-304f-411f-9ae6-9e9b9e679334 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:16.128894 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774b53f-304f-411f-9ae6-9e9b9e679334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:16.156129 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-1774b53f-304f-411f-9ae6-9e9b9e679334 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:16.157336 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-1774b53f-304f-411f-9ae6-9e9b9e679334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:16.186111 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:16.230270 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 449/915] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:16 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:16.266125 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5140da-f2a1-43a4-80a0-b6aa893c923d None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:16.307451 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:16.388178 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5140da-f2a1-43a4-80a0-b6aa893c923d None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:16.426760 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab51fd-572e-4794-abc3-782ccfb311d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:16.427426 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab51fd-572e-4794-abc3-782ccfb311d0 None admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:16.427712 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab51fd-572e-4794-abc3-782ccfb311d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:16.427991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab51fd-572e-4794-abc3-782ccfb311d0 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:16.428714 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab51fd-572e-4794-abc3-782ccfb311d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:16.430107 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab51fd-572e-4794-abc3-782ccfb311d0 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:16.445496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 467/916] 10.222.0.26 () {60 vars in 1141 bytes} [Sat Jun 25 20:38:16 2022] POST /identity/v3/services => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:38:18.723988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9232a99-fbdb-4dc4-b58b-fddeff2d7471 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:18.724841 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9232a99-fbdb-4dc4-b58b-fddeff2d7471 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:18.724841 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9232a99-fbdb-4dc4-b58b-fddeff2d7471 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:18.727172 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 450/917] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:38:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:18.733504 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f679f1-db2a-4501-94b1-b28eef822f62 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:18.734195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f679f1-db2a-4501-94b1-b28eef822f62 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:18.734398 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f679f1-db2a-4501-94b1-b28eef822f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:18.756680 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-14f679f1-db2a-4501-94b1-b28eef822f62 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:18.757890 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-14f679f1-db2a-4501-94b1-b28eef822f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:18.839685 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 468/918] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:18 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:18.876396 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9232a99-fbdb-4dc4-b58b-fddeff2d7471 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:18.990235 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9232a99-fbdb-4dc4-b58b-fddeff2d7471 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:19.027494 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cb448-ebbc-4358-a81c-2b614a83f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:19.028292 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb448-ebbc-4358-a81c-2b614a83f038 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:19.028580 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb448-ebbc-4358-a81c-2b614a83f038 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:19.028857 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cb448-ebbc-4358-a81c-2b614a83f038 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:19.029545 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cb448-ebbc-4358-a81c-2b614a83f038 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:19.030973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cb448-ebbc-4358-a81c-2b614a83f038 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-267cb448-ebbc-4358-a81c-2b614a83f038 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:19.043431 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:19.044626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:19.045986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 451/919] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Jun 25 20:38:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:19.051204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f679f1-db2a-4501-94b1-b28eef822f62 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:19.074623 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:19.177583 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f679f1-db2a-4501-94b1-b28eef822f62 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:19.213367 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1dcd1-0712-4492-8e59-6fc1ef8e3438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:19.214035 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1dcd1-0712-4492-8e59-6fc1ef8e3438 None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:19.214316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1dcd1-0712-4492-8e59-6fc1ef8e3438 None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:19.214631 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1dcd1-0712-4492-8e59-6fc1ef8e3438 None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:19.215334 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1dcd1-0712-4492-8e59-6fc1ef8e3438 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:19.215640 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1dcd1-0712-4492-8e59-6fc1ef8e3438 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:19.217361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1dcd1-0712-4492-8e59-6fc1ef8e3438 None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:19.222944 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 469/920] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Jun 25 20:38:19 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:19.229472 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cb448-ebbc-4358-a81c-2b614a83f038 None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:19.262253 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:19.335133 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cb448-ebbc-4358-a81c-2b614a83f038 None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:19.378164 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f722a16-3ae5-4351-b36d-6fba2362c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:19.378845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f722a16-3ae5-4351-b36d-6fba2362c197 None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:19.379132 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f722a16-3ae5-4351-b36d-6fba2362c197 None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:19.379403 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f722a16-3ae5-4351-b36d-6fba2362c197 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:19.380185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f722a16-3ae5-4351-b36d-6fba2362c197 None admin] RBAC: Adding query filter params (interface=public, service_id=0993b5c5a7024b528c4b61d508ecc84a, region_id=RegionOne) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:19.380492 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f722a16-3ae5-4351-b36d-6fba2362c197 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:19.381872 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f722a16-3ae5-4351-b36d-6fba2362c197 None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:19.387635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 452/921] 10.222.0.26 () {56 vars in 1251 bytes} [Sat Jun 25 20:38:19 2022] GET /identity/v3/endpoints?service_id=0993b5c5a7024b528c4b61d508ecc84a&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:38:19.393677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1dcd1-0712-4492-8e59-6fc1ef8e3438 None admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:19.480006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:19.500528 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1dcd1-0712-4492-8e59-6fc1ef8e3438 None admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:19.535797 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff5b5c-57b0-4840-bdf0-c070afdba46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:19.536384 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff5b5c-57b0-4840-bdf0-c070afdba46d None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:19.536664 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff5b5c-57b0-4840-bdf0-c070afdba46d None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:19.536938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff5b5c-57b0-4840-bdf0-c070afdba46d None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:19.537609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff5b5c-57b0-4840-bdf0-c070afdba46d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:19.539033 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff5b5c-57b0-4840-bdf0-c070afdba46d None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:19.545499 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 470/922] 10.222.0.26 () {56 vars in 1087 bytes} [Sat Jun 25 20:38:19 2022] GET /identity/v3/services => generated 1962 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:38:21.793447 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f82cc-cd67-4975-ac3e-2ef1a320ad03 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:21.794311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f82cc-cd67-4975-ac3e-2ef1a320ad03 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:21.794311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f82cc-cd67-4975-ac3e-2ef1a320ad03 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:21.796618 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 453/923] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:38:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:38:21.805156 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47f66-9eaf-4558-9857-d8d9c34f0c32 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:21.805570 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47f66-9eaf-4558-9857-d8d9c34f0c32 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:21.805804 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc47f66-9eaf-4558-9857-d8d9c34f0c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:21.824699 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-abc47f66-9eaf-4558-9857-d8d9c34f0c32 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:38:21.825917 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-abc47f66-9eaf-4558-9857-d8d9c34f0c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:38:21.906770 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 471/924] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:38:21 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 25 20:38:21.931362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f82cc-cd67-4975-ac3e-2ef1a320ad03 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:22.030392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:22.041182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003f82cc-cd67-4975-ac3e-2ef1a320ad03 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:22.076496 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e23b6e-8ee4-42cc-8765-d12de9b4bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:22.077258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e23b6e-8ee4-42cc-8765-d12de9b4bc9b None admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:22.077556 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e23b6e-8ee4-42cc-8765-d12de9b4bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:22.077831 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e23b6e-8ee4-42cc-8765-d12de9b4bc9b None admin] PATH_INFO: `/v3/services/placement` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:22.078516 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e23b6e-8ee4-42cc-8765-d12de9b4bc9b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:22.079900 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e23b6e-8ee4-42cc-8765-d12de9b4bc9b None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application [None req-f7e23b6e-8ee4-42cc-8765-d12de9b4bc9b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 25 20:38:22.091917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 25 20:38:22.093362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.get_or_create( Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application with Lock( Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self._enter() Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application return self.creator() Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application created_value = creator( Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: ERROR keystone.server.flask.application Jun 25 20:38:22.094674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 454/925] 10.222.0.26 () {56 vars in 1117 bytes} [Sat Jun 25 20:38:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 25 20:38:22.102351 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47f66-9eaf-4558-9857-d8d9c34f0c32 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:22.183246 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:22.209143 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc47f66-9eaf-4558-9857-d8d9c34f0c32 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:22.253085 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91887a7-b3cc-48e9-83f2-517ed3c64cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:22.253747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91887a7-b3cc-48e9-83f2-517ed3c64cdf None admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:22.254034 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91887a7-b3cc-48e9-83f2-517ed3c64cdf None admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:22.254313 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91887a7-b3cc-48e9-83f2-517ed3c64cdf None admin] PATH_INFO: `/v3/services` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:22.255053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91887a7-b3cc-48e9-83f2-517ed3c64cdf None admin] RBAC: Adding query filter params (name=placement) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:38:22.255364 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91887a7-b3cc-48e9-83f2-517ed3c64cdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:22.256763 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91887a7-b3cc-48e9-83f2-517ed3c64cdf None admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:22.262534 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 472/926] 10.222.0.26 () {56 vars in 1116 bytes} [Sat Jun 25 20:38:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:38:22.268421 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e23b6e-8ee4-42cc-8765-d12de9b4bc9b None admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:38:22.373631 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e23b6e-8ee4-42cc-8765-d12de9b4bc9b None admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:38:22.407894 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb4386-e24d-4a1f-a70e-f68838c87caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:38:22.408532 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb4386-e24d-4a1f-a70e-f68838c87caa None admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:38:22.408816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb4386-e24d-4a1f-a70e-f68838c87caa None admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:38:22.409090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb4386-e24d-4a1f-a70e-f68838c87caa None admin] PATH_INFO: `/v3/endpoints` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:38:22.409826 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb4386-e24d-4a1f-a70e-f68838c87caa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:38:22.411241 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb4386-e24d-4a1f-a70e-f68838c87caa None admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:38:22.433013 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 455/927] 10.222.0.26 () {60 vars in 1144 bytes} [Sat Jun 25 20:38:22 2022] POST /identity/v3/endpoints => generated 331 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:38:32.258941 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=30 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:38:32.427953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:21.687795 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc6a2-fdf9-49f3-96f0-a354c56151e4 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:21.688816 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc6a2-fdf9-49f3-96f0-a354c56151e4 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:21.692463 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbc6a2-fdf9-49f3-96f0-a354c56151e4 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:21.694756 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 473/928] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:21.698790 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e7ca-68c5-4ea1-8466-4e577871e278 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:21.699517 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e7ca-68c5-4ea1-8466-4e577871e278 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:21.699517 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e7ca-68c5-4ea1-8466-4e577871e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:21.723147 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-6702e7ca-68c5-4ea1-8466-4e577871e278 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:21.724757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-6702e7ca-68c5-4ea1-8466-4e577871e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:21.834039 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 456/929] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:21.887390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b668fc8-227d-439f-816b-8172b33b3f1b None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:21.887672 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b668fc8-227d-439f-816b-8172b33b3f1b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:21.887939 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b668fc8-227d-439f-816b-8172b33b3f1b None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:21.889786 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 474/930] 10.222.0.26 () {54 vars in 964 bytes} [Sat Jun 25 20:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:21.905612 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4da8e-8838-41fd-b006-d3048f212085 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:21.907946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4da8e-8838-41fd-b006-d3048f212085 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:21.909161 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4da8e-8838-41fd-b006-d3048f212085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:22.022934 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-9dc4da8e-8838-41fd-b006-d3048f212085 None None] MFA Rules not processed for user `6ddd2eb988484d7ab0e64323fe4f4602`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:22.024140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-9dc4da8e-8838-41fd-b006-d3048f212085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:22.119491 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 457/931] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Jun 25 20:39:21 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:22.127925 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b668fc8-227d-439f-816b-8172b33b3f1b None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:22.138833 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b668fc8-227d-439f-816b-8172b33b3f1b None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:22.142154 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e0506-0299-4ffc-9bac-54a00965b2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:22.142824 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0506-0299-4ffc-9bac-54a00965b2ca service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:22.143455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0506-0299-4ffc-9bac-54a00965b2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:22.143740 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e0506-0299-4ffc-9bac-54a00965b2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:22.152759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e0506-0299-4ffc-9bac-54a00965b2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:22.154476 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e0506-0299-4ffc-9bac-54a00965b2ca service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:22.163989 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 475/932] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:24.691981 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d506c-ae81-41a7-bd8e-ed59d9cc02b9 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:24.692534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d506c-ae81-41a7-bd8e-ed59d9cc02b9 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:24.692534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d506c-ae81-41a7-bd8e-ed59d9cc02b9 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:24.693924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 458/933] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:24.699344 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eade8-2a0b-4445-8a93-47d3e3e4a6a5 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:24.699759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eade8-2a0b-4445-8a93-47d3e3e4a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:24.699874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eade8-2a0b-4445-8a93-47d3e3e4a6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:24.718174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-587eade8-2a0b-4445-8a93-47d3e3e4a6a5 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:24.719408 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-587eade8-2a0b-4445-8a93-47d3e3e4a6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:24.728273 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 476/934] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:24.767218 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d506c-ae81-41a7-bd8e-ed59d9cc02b9 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:24.780258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d506c-ae81-41a7-bd8e-ed59d9cc02b9 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:24.784870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bb13e-8582-4e75-8e9f-e993d3e1a194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:24.785613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb13e-8582-4e75-8e9f-e993d3e1a194 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:24.786045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb13e-8582-4e75-8e9f-e993d3e1a194 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:24.786345 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb13e-8582-4e75-8e9f-e993d3e1a194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:24.797330 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bb13e-8582-4e75-8e9f-e993d3e1a194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:24.798859 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bb13e-8582-4e75-8e9f-e993d3e1a194 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:24.809380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 459/935] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:27.493611 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493be5a-cda8-4e4a-a16e-ff335d8db62d None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:27.494284 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493be5a-cda8-4e4a-a16e-ff335d8db62d None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:27.494284 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493be5a-cda8-4e4a-a16e-ff335d8db62d None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:27.495847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 477/936] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:27.502793 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84797a8-03b7-460f-bf43-8dc543435892 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:27.503386 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84797a8-03b7-460f-bf43-8dc543435892 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:27.503386 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84797a8-03b7-460f-bf43-8dc543435892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:27.547861 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-a84797a8-03b7-460f-bf43-8dc543435892 None None] MFA Rules not processed for user `84fa788ab3d84dc2ae333d817ad98651`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:27.549107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-a84797a8-03b7-460f-bf43-8dc543435892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:27.596025 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:27.623947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 460/937] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:27 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:27.663289 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493be5a-cda8-4e4a-a16e-ff335d8db62d None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:27.674308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493be5a-cda8-4e4a-a16e-ff335d8db62d None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:27.677909 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234671f-6449-46ff-9163-17e352784f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:27.678592 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234671f-6449-46ff-9163-17e352784f64 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:27.678879 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234671f-6449-46ff-9163-17e352784f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:27.679157 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234671f-6449-46ff-9163-17e352784f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:27.689361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234671f-6449-46ff-9163-17e352784f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:27.690860 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234671f-6449-46ff-9163-17e352784f64 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:27.700648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 478/938] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:27 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:30.585490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961c68a-d5d8-4191-aa8e-07bf3e3f6507 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.586179 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961c68a-d5d8-4191-aa8e-07bf3e3f6507 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.586179 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961c68a-d5d8-4191-aa8e-07bf3e3f6507 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.587401 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 461/939] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:30.593714 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fc0f-b0f7-454b-80c4-25e952bba3f7 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.594471 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fc0f-b0f7-454b-80c4-25e952bba3f7 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.594618 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fc0f-b0f7-454b-80c4-25e952bba3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.619277 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-3f93fc0f-b0f7-454b-80c4-25e952bba3f7 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:30.620296 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-3f93fc0f-b0f7-454b-80c4-25e952bba3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:30.697383 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 479/940] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:30 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:30.764542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3872d97-d9a0-40f1-a017-a5f526afc69a None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.764883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3872d97-d9a0-40f1-a017-a5f526afc69a None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.765285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3872d97-d9a0-40f1-a017-a5f526afc69a None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.767507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 462/941] 10.222.0.26 () {54 vars in 964 bytes} [Sat Jun 25 20:39:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:30.777085 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4e5c4-dcf5-4d54-b013-e75daa87a5bc None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.777483 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4e5c4-dcf5-4d54-b013-e75daa87a5bc None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.777790 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4e5c4-dcf5-4d54-b013-e75daa87a5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.799612 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-19b4e5c4-dcf5-4d54-b013-e75daa87a5bc None None] MFA Rules not processed for user `6ddd2eb988484d7ab0e64323fe4f4602`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:30.800839 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-19b4e5c4-dcf5-4d54-b013-e75daa87a5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:30.809192 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 480/942] 10.222.0.26 () {58 vars in 1061 bytes} [Sat Jun 25 20:39:30 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:30.818017 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3872d97-d9a0-40f1-a017-a5f526afc69a None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:30.831461 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3872d97-d9a0-40f1-a017-a5f526afc69a None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:30.836211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f89d6-af15-42df-8052-86b772c96671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:30.836780 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f89d6-af15-42df-8052-86b772c96671 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:30.837065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f89d6-af15-42df-8052-86b772c96671 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:30.837337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f89d6-af15-42df-8052-86b772c96671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:30.847377 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f89d6-af15-42df-8052-86b772c96671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:30.848806 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f89d6-af15-42df-8052-86b772c96671 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:30.860877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 463/943] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:30 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:34.357899 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16ddd8-fca4-45b7-ab82-21a55edf02fa None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:34.358512 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16ddd8-fca4-45b7-ab82-21a55edf02fa None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:34.358512 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16ddd8-fca4-45b7-ab82-21a55edf02fa None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:34.359795 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 481/944] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:34.365165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4a1c9-4284-4745-9d05-add2d5f8e45e None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:34.365575 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4a1c9-4284-4745-9d05-add2d5f8e45e None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:34.365747 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4a1c9-4284-4745-9d05-add2d5f8e45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:34.384659 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-7ec4a1c9-4284-4745-9d05-add2d5f8e45e None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:34.385882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-7ec4a1c9-4284-4745-9d05-add2d5f8e45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:34.395332 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 464/945] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:34.431904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16ddd8-fca4-45b7-ab82-21a55edf02fa None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:34.444267 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16ddd8-fca4-45b7-ab82-21a55edf02fa None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:34.448514 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda61843-720c-413f-bc79-e21cca5e9150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:34.449272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61843-720c-413f-bc79-e21cca5e9150 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:34.449554 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61843-720c-413f-bc79-e21cca5e9150 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:34.449826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda61843-720c-413f-bc79-e21cca5e9150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:34.459046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda61843-720c-413f-bc79-e21cca5e9150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:34.460492 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda61843-720c-413f-bc79-e21cca5e9150 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:34.470060 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 482/946] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:36.826072 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5aca0-f204-4d2f-b003-e6d98f6f09c1 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:36.826629 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5aca0-f204-4d2f-b003-e6d98f6f09c1 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:36.826629 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5aca0-f204-4d2f-b003-e6d98f6f09c1 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:36.827916 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 465/947] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:36.833217 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b337b-e2b0-4071-b0f9-271f8e1cf554 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:36.833656 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b337b-e2b0-4071-b0f9-271f8e1cf554 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:36.833920 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b337b-e2b0-4071-b0f9-271f8e1cf554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:36.852642 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-997b337b-e2b0-4071-b0f9-271f8e1cf554 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:36.853856 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-997b337b-e2b0-4071-b0f9-271f8e1cf554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:36.863011 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 483/948] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:36.899267 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5aca0-f204-4d2f-b003-e6d98f6f09c1 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:36.911303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5aca0-f204-4d2f-b003-e6d98f6f09c1 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:36.915105 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678aa07-ff5c-4d0a-82a4-b109e42770df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:36.915752 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678aa07-ff5c-4d0a-82a4-b109e42770df service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:36.916039 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678aa07-ff5c-4d0a-82a4-b109e42770df service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:36.916316 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678aa07-ff5c-4d0a-82a4-b109e42770df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:36.926948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678aa07-ff5c-4d0a-82a4-b109e42770df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:36.928640 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678aa07-ff5c-4d0a-82a4-b109e42770df service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:36.939616 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 466/949] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:39.264058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d946b-009a-4450-991c-b0c34cfc682b None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:39.264992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d946b-009a-4450-991c-b0c34cfc682b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:39.265272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d946b-009a-4450-991c-b0c34cfc682b None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:39.266721 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 484/950] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:39.272194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412a33e-f1a3-4735-a0b6-e6145d06676b None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:39.272594 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412a33e-f1a3-4735-a0b6-e6145d06676b None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:39.272820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412a33e-f1a3-4735-a0b6-e6145d06676b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:39.291592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-1412a33e-f1a3-4735-a0b6-e6145d06676b None None] MFA Rules not processed for user `84fa788ab3d84dc2ae333d817ad98651`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:39.292792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-1412a33e-f1a3-4735-a0b6-e6145d06676b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:39.301721 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 467/951] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:39 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:39.339604 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d946b-009a-4450-991c-b0c34cfc682b None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:39.352257 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d946b-009a-4450-991c-b0c34cfc682b None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:39.356997 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b9217-9a4c-4884-ab20-2043a29fa54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:39.357662 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b9217-9a4c-4884-ab20-2043a29fa54e service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:39.357944 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b9217-9a4c-4884-ab20-2043a29fa54e service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:39.358210 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b9217-9a4c-4884-ab20-2043a29fa54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:39.367575 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b9217-9a4c-4884-ab20-2043a29fa54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:39.369045 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b9217-9a4c-4884-ab20-2043a29fa54e service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:39.378737 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 485/952] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:39 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:41.911543 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daaa09-99ba-44f2-8583-366552f4cd48 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:41.912156 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daaa09-99ba-44f2-8583-366552f4cd48 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:41.912156 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11daaa09-99ba-44f2-8583-366552f4cd48 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:41.913455 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 468/953] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:41.919369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093d9c-3f1c-44be-89a7-8330de4cf51a None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:41.919931 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093d9c-3f1c-44be-89a7-8330de4cf51a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:41.919931 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e093d9c-3f1c-44be-89a7-8330de4cf51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:41.939596 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-2e093d9c-3f1c-44be-89a7-8330de4cf51a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:41.940837 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-2e093d9c-3f1c-44be-89a7-8330de4cf51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:41.949422 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 486/954] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:41.987579 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daaa09-99ba-44f2-8583-366552f4cd48 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:41.999880 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11daaa09-99ba-44f2-8583-366552f4cd48 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:42.003701 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fdc64-91ac-4fad-a3a3-2e6780e29c20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:42.004437 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fdc64-91ac-4fad-a3a3-2e6780e29c20 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:42.004732 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fdc64-91ac-4fad-a3a3-2e6780e29c20 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:42.005016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fdc64-91ac-4fad-a3a3-2e6780e29c20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:42.016956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fdc64-91ac-4fad-a3a3-2e6780e29c20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:42.018525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fdc64-91ac-4fad-a3a3-2e6780e29c20 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:42.030816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 469/955] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:44.364703 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508265f-4d43-43c4-9400-9fb3d74a4193 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:44.365182 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508265f-4d43-43c4-9400-9fb3d74a4193 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:44.365295 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508265f-4d43-43c4-9400-9fb3d74a4193 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:44.366941 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 487/956] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:44.373510 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc0dce-339d-43f3-a05a-8940e9f3abe7 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:44.374009 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc0dce-339d-43f3-a05a-8940e9f3abe7 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:44.374009 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc0dce-339d-43f3-a05a-8940e9f3abe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:44.393497 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-d5fc0dce-339d-43f3-a05a-8940e9f3abe7 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:44.394744 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-d5fc0dce-339d-43f3-a05a-8940e9f3abe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:44.403875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 470/957] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:44.444088 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508265f-4d43-43c4-9400-9fb3d74a4193 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:44.450182 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=68 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:44.457041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508265f-4d43-43c4-9400-9fb3d74a4193 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:44.460834 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85767b2d-53b5-436d-a067-038c07606f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:44.461501 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85767b2d-53b5-436d-a067-038c07606f73 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:44.461782 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85767b2d-53b5-436d-a067-038c07606f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:44.462058 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85767b2d-53b5-436d-a067-038c07606f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:44.472825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85767b2d-53b5-436d-a067-038c07606f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:44.474285 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85767b2d-53b5-436d-a067-038c07606f73 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:44.484944 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 488/958] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:47.201689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13dcb5-8539-4e2d-a724-564f9fd0a56f None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:47.202236 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13dcb5-8539-4e2d-a724-564f9fd0a56f None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:47.202236 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13dcb5-8539-4e2d-a724-564f9fd0a56f None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:47.203586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 471/959] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:47.209941 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87c380-6334-4b20-882c-0418db091d7b None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:47.210709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87c380-6334-4b20-882c-0418db091d7b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:47.210898 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87c380-6334-4b20-882c-0418db091d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:47.236970 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-3e87c380-6334-4b20-882c-0418db091d7b None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:47.238165 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-3e87c380-6334-4b20-882c-0418db091d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:47.247339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 489/960] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:47 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:47.287135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13dcb5-8539-4e2d-a724-564f9fd0a56f None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:47.306834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13dcb5-8539-4e2d-a724-564f9fd0a56f None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:47.312068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60870dfc-bd2d-475e-abb2-3d4e7250b56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:47.312703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60870dfc-bd2d-475e-abb2-3d4e7250b56d service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:47.312993 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60870dfc-bd2d-475e-abb2-3d4e7250b56d service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:47.313269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60870dfc-bd2d-475e-abb2-3d4e7250b56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:47.323205 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60870dfc-bd2d-475e-abb2-3d4e7250b56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:47.324661 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60870dfc-bd2d-475e-abb2-3d4e7250b56d service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:47.334389 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 472/961] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:47 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:51.520144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2230-419a-43a0-9220-71f1028db9b0 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:51.520701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2230-419a-43a0-9220-71f1028db9b0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:51.520701 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd2230-419a-43a0-9220-71f1028db9b0 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:51.522043 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 490/962] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:51.527268 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4f206-b49e-4c3e-9c4e-982463c99106 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:51.527740 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4f206-b49e-4c3e-9c4e-982463c99106 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:51.527971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4f206-b49e-4c3e-9c4e-982463c99106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:51.547444 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-e7d4f206-b49e-4c3e-9c4e-982463c99106 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:51.548626 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-e7d4f206-b49e-4c3e-9c4e-982463c99106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:51.557514 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 473/963] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:51.597495 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2230-419a-43a0-9220-71f1028db9b0 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:51.610236 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd2230-419a-43a0-9220-71f1028db9b0 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:51.614118 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7c628-61db-4cfe-a7b3-ac15b1dbfd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:51.614787 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c628-61db-4cfe-a7b3-ac15b1dbfd4c service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:51.615071 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c628-61db-4cfe-a7b3-ac15b1dbfd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:51.615352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7c628-61db-4cfe-a7b3-ac15b1dbfd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:51.625129 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7c628-61db-4cfe-a7b3-ac15b1dbfd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:51.626666 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7c628-61db-4cfe-a7b3-ac15b1dbfd4c service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:51.636091 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 491/964] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:54.478913 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e7c4-46b8-4c1a-9271-69e79461b114 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:54.479394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e7c4-46b8-4c1a-9271-69e79461b114 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:54.479469 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028e7c4-46b8-4c1a-9271-69e79461b114 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:54.481377 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 474/965] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:54.487045 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3c01-d5ee-4228-bb0f-9cb90e39ad15 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:54.487461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3c01-d5ee-4228-bb0f-9cb90e39ad15 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:54.487597 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb3c01-d5ee-4228-bb0f-9cb90e39ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:54.506396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-3cbb3c01-d5ee-4228-bb0f-9cb90e39ad15 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:54.507627 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-3cbb3c01-d5ee-4228-bb0f-9cb90e39ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:54.516193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 492/966] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:54 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:39:54.554971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e7c4-46b8-4c1a-9271-69e79461b114 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:54.566380 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028e7c4-46b8-4c1a-9271-69e79461b114 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:54.570241 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30f725-9ace-4058-8393-e22581ce3f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:54.570902 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f725-9ace-4058-8393-e22581ce3f14 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:54.571187 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f725-9ace-4058-8393-e22581ce3f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:54.571460 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30f725-9ace-4058-8393-e22581ce3f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:54.580711 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f725-9ace-4058-8393-e22581ce3f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:54.582153 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30f725-9ace-4058-8393-e22581ce3f14 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:54.591944 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 475/967] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:54 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:39:58.976548 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13b3a6-02aa-458d-b126-2782ef4566f5 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:58.977124 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13b3a6-02aa-458d-b126-2782ef4566f5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:58.977124 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13b3a6-02aa-458d-b126-2782ef4566f5 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:58.978441 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 493/968] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:39:58.985163 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6455f-5cf9-49ba-be46-76d37e5fa79a None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:58.985885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6455f-5cf9-49ba-be46-76d37e5fa79a None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:58.986096 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6455f-5cf9-49ba-be46-76d37e5fa79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:58.997979 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=54 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:39:59.016825 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-41d6455f-5cf9-49ba-be46-76d37e5fa79a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:39:59.018046 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-41d6455f-5cf9-49ba-be46-76d37e5fa79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:39:59.027510 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 476/969] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:39:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:39:59.068495 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13b3a6-02aa-458d-b126-2782ef4566f5 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:39:59.081103 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13b3a6-02aa-458d-b126-2782ef4566f5 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:39:59.084710 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4571af2-b0dc-4a46-9b8a-0dab197615eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:39:59.085359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4571af2-b0dc-4a46-9b8a-0dab197615eb service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:39:59.085645 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4571af2-b0dc-4a46-9b8a-0dab197615eb service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:39:59.085938 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4571af2-b0dc-4a46-9b8a-0dab197615eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:39:59.095553 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4571af2-b0dc-4a46-9b8a-0dab197615eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:39:59.097334 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4571af2-b0dc-4a46-9b8a-0dab197615eb service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:39:59.107231 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 494/970] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:39:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:04.591335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77dcc6-11de-47a3-a467-caf227ec109c None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:04.591906 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77dcc6-11de-47a3-a467-caf227ec109c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:04.592160 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77dcc6-11de-47a3-a467-caf227ec109c None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:04.593939 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 477/971] 10.222.0.26 () {54 vars in 921 bytes} [Sat Jun 25 20:40:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:04.599658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce8a02-4782-4040-b7b7-ade07c1e387a None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:04.600439 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce8a02-4782-4040-b7b7-ade07c1e387a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:04.600873 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce8a02-4782-4040-b7b7-ade07c1e387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:04.639677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-8bce8a02-4782-4040-b7b7-ade07c1e387a None None] MFA Rules not processed for user `d91c64b1ed4e49c7870ac00844b29bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:04.641131 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-8bce8a02-4782-4040-b7b7-ade07c1e387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:04.714654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 495/972] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Jun 25 20:40:04 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:09.010806 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=2 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:40:09.319153 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106fef-301e-4ceb-8231-57c2d216eb89 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:09.319706 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106fef-301e-4ceb-8231-57c2d216eb89 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:09.319970 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d106fef-301e-4ceb-8231-57c2d216eb89 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:09.321552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 478/973] 10.222.0.26 () {54 vars in 921 bytes} [Sat Jun 25 20:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:09.326759 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61972f3e-308b-420c-8afa-9e0b4f2e9616 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:09.327644 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61972f3e-308b-420c-8afa-9e0b4f2e9616 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:09.328122 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61972f3e-308b-420c-8afa-9e0b4f2e9616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:09.348144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-61972f3e-308b-420c-8afa-9e0b4f2e9616 None None] MFA Rules not processed for user `d91c64b1ed4e49c7870ac00844b29bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:09.349652 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-61972f3e-308b-420c-8afa-9e0b4f2e9616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:09.359025 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 496/974] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Jun 25 20:40:09 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:10.744448 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf13c31-9e22-46b9-b54c-b29bda5a77cf None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:10.745033 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf13c31-9e22-46b9-b54c-b29bda5a77cf None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:10.745033 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf13c31-9e22-46b9-b54c-b29bda5a77cf None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:10.746406 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 479/975] 10.222.0.26 () {54 vars in 921 bytes} [Sat Jun 25 20:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:10.751820 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30191036-53ad-45c3-ad38-8c55e60469b5 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:10.752297 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30191036-53ad-45c3-ad38-8c55e60469b5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:10.752400 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30191036-53ad-45c3-ad38-8c55e60469b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:10.770780 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-30191036-53ad-45c3-ad38-8c55e60469b5 None None] MFA Rules not processed for user `d91c64b1ed4e49c7870ac00844b29bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:10.771970 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-30191036-53ad-45c3-ad38-8c55e60469b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:10.780700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 497/976] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Jun 25 20:40:10 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:14.641589 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f978b54-7cf5-47c4-8af9-c244d1a7ca1c None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:14.642452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f978b54-7cf5-47c4-8af9-c244d1a7ca1c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:14.642875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f978b54-7cf5-47c4-8af9-c244d1a7ca1c None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:14.644377 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 480/977] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:14.649810 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284d763-95f0-429e-94d8-862b4a81ba59 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:14.650232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284d763-95f0-429e-94d8-862b4a81ba59 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:14.650410 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284d763-95f0-429e-94d8-862b4a81ba59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:14.657247 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=69 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:40:14.671504 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-3284d763-95f0-429e-94d8-862b4a81ba59 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:14.672959 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-3284d763-95f0-429e-94d8-862b4a81ba59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:14.681443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 498/978] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:14.739256 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb134cc9-5987-47d7-8936-e85b1f9f1d13 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:14.739856 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb134cc9-5987-47d7-8936-e85b1f9f1d13 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:14.740308 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb134cc9-5987-47d7-8936-e85b1f9f1d13 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:14.742125 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 481/979] 10.222.0.26 () {54 vars in 961 bytes} [Sat Jun 25 20:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:14.750531 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1096a1-3c4f-4283-8352-dab6acf555e1 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:14.751173 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1096a1-3c4f-4283-8352-dab6acf555e1 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:14.751651 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1096a1-3c4f-4283-8352-dab6acf555e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:14.791731 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-0d1096a1-3c4f-4283-8352-dab6acf555e1 None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:14.792904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-0d1096a1-3c4f-4283-8352-dab6acf555e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:14.867509 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 499/980] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Jun 25 20:40:14 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:14.875690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb134cc9-5987-47d7-8936-e85b1f9f1d13 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:14.890057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb134cc9-5987-47d7-8936-e85b1f9f1d13 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:14.896452 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b501199-1865-45b2-bc61-f839c7eb3608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:14.897870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501199-1865-45b2-bc61-f839c7eb3608 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:14.898305 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501199-1865-45b2-bc61-f839c7eb3608 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:14.898749 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b501199-1865-45b2-bc61-f839c7eb3608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:14.907703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501199-1865-45b2-bc61-f839c7eb3608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:14.909507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b501199-1865-45b2-bc61-f839c7eb3608 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:14.934583 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 482/981] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:17.443054 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8439429-d7a7-40bb-9c3b-75624be68357 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:17.443616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8439429-d7a7-40bb-9c3b-75624be68357 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:17.443616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8439429-d7a7-40bb-9c3b-75624be68357 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:17.445154 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 500/982] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:17.450232 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d057c9-0031-493a-bd45-c9c9c7eeee66 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:17.450765 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d057c9-0031-493a-bd45-c9c9c7eeee66 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:17.450875 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d057c9-0031-493a-bd45-c9c9c7eeee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:17.470012 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-f2d057c9-0031-493a-bd45-c9c9c7eeee66 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:17.474653 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-f2d057c9-0031-493a-bd45-c9c9c7eeee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:17.490470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 483/983] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:17.529378 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8439429-d7a7-40bb-9c3b-75624be68357 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:17.544831 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8439429-d7a7-40bb-9c3b-75624be68357 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:17.550444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf5120-767d-45e8-b293-eeee4880be7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:17.551104 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf5120-767d-45e8-b293-eeee4880be7f service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:17.551394 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf5120-767d-45e8-b293-eeee4880be7f service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:17.551671 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf5120-767d-45e8-b293-eeee4880be7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:17.561332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf5120-767d-45e8-b293-eeee4880be7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:17.563490 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf5120-767d-45e8-b293-eeee4880be7f service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:17.574286 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 501/984] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:20.188999 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb63dd-3040-4c5b-9615-21a05c0b9835 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:20.189537 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb63dd-3040-4c5b-9615-21a05c0b9835 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:20.189537 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb63dd-3040-4c5b-9615-21a05c0b9835 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:20.190960 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 484/985] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:20.196975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c17c-d9a4-45da-bec8-10be3feb382a None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:20.197767 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c17c-d9a4-45da-bec8-10be3feb382a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:20.198246 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8c17c-d9a4-45da-bec8-10be3feb382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:20.219554 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-a5d8c17c-d9a4-45da-bec8-10be3feb382a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:20.220765 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-a5d8c17c-d9a4-45da-bec8-10be3feb382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:20.232294 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 502/986] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:20.288514 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba841528-0d5e-4bde-96ec-fd201231814c None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:20.288805 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba841528-0d5e-4bde-96ec-fd201231814c None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:20.289086 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba841528-0d5e-4bde-96ec-fd201231814c None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:20.290493 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 485/987] 10.222.0.26 () {54 vars in 961 bytes} [Sat Jun 25 20:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:20.296361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab8e4-ea91-4725-a8f3-1071b23985f1 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:20.296651 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab8e4-ea91-4725-a8f3-1071b23985f1 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:20.296924 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab8e4-ea91-4725-a8f3-1071b23985f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:20.315155 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-6fbab8e4-ea91-4725-a8f3-1071b23985f1 None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:20.316345 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-6fbab8e4-ea91-4725-a8f3-1071b23985f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:20.324864 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 503/988] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Jun 25 20:40:20 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:20.332794 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba841528-0d5e-4bde-96ec-fd201231814c None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:20.346148 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba841528-0d5e-4bde-96ec-fd201231814c None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:20.351573 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da109b-e88e-4fa2-807e-95617088e7bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:20.352203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da109b-e88e-4fa2-807e-95617088e7bc service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:20.352488 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da109b-e88e-4fa2-807e-95617088e7bc service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:20.352950 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da109b-e88e-4fa2-807e-95617088e7bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:20.361017 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da109b-e88e-4fa2-807e-95617088e7bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:20.362641 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da109b-e88e-4fa2-807e-95617088e7bc service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:20.372212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 486/989] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:22.812000 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1fabc-06ef-4216-a78a-2846063301fc None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:22.812899 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1fabc-06ef-4216-a78a-2846063301fc None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:22.813328 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1fabc-06ef-4216-a78a-2846063301fc None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:22.815158 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 504/990] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:22.820718 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cbc55-9db9-4371-a828-240d30615288 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:22.821572 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cbc55-9db9-4371-a828-240d30615288 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:22.822100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cbc55-9db9-4371-a828-240d30615288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:22.842250 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-c32cbc55-9db9-4371-a828-240d30615288 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:22.843760 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-c32cbc55-9db9-4371-a828-240d30615288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:22.852467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 487/991] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:22.900246 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1fabc-06ef-4216-a78a-2846063301fc None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:22.916062 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1fabc-06ef-4216-a78a-2846063301fc None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:22.931906 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c18beb-a093-44e4-8764-2e6c4b3a5dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:22.932851 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c18beb-a093-44e4-8764-2e6c4b3a5dd9 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:22.933361 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c18beb-a093-44e4-8764-2e6c4b3a5dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:22.933838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c18beb-a093-44e4-8764-2e6c4b3a5dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:22.944607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c18beb-a093-44e4-8764-2e6c4b3a5dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:22.947248 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c18beb-a093-44e4-8764-2e6c4b3a5dd9 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:22.961558 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 505/992] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:24.704284 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84843bba-affe-4ccc-95a9-38d38cfc5910 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:24.704788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84843bba-affe-4ccc-95a9-38d38cfc5910 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:24.704870 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84843bba-affe-4ccc-95a9-38d38cfc5910 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:24.712104 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a976e-7948-4a53-9d63-056fbc623c2d None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:24.712546 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a976e-7948-4a53-9d63-056fbc623c2d None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:24.712660 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a976e-7948-4a53-9d63-056fbc623c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:24.714962 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 488/993] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:24.732698 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-782a976e-7948-4a53-9d63-056fbc623c2d None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:24.734168 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-782a976e-7948-4a53-9d63-056fbc623c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:24.754460 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 506/994] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:40:25.050080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5191a1a-b35a-4d6f-a8a5-6af11aa46781 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:25.050080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5191a1a-b35a-4d6f-a8a5-6af11aa46781 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:25.050080 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5191a1a-b35a-4d6f-a8a5-6af11aa46781 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:25.051799 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 489/995] 10.222.0.26 () {54 vars in 963 bytes} [Sat Jun 25 20:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:25.057324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465d52b-e72e-4b97-bd9a-dcb70b908981 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:25.057700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465d52b-e72e-4b97-bd9a-dcb70b908981 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:25.058051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3465d52b-e72e-4b97-bd9a-dcb70b908981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:25.097892 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-3465d52b-e72e-4b97-bd9a-dcb70b908981 None None] MFA Rules not processed for user `fc0920a9a54d4d839f1e2125431e9d19`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:25.099237 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-3465d52b-e72e-4b97-bd9a-dcb70b908981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:25.161135 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 507/996] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Jun 25 20:40:25 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:25.168757 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5191a1a-b35a-4d6f-a8a5-6af11aa46781 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:25.179638 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5191a1a-b35a-4d6f-a8a5-6af11aa46781 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:25.183202 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912e36b-b793-4d13-9551-031ad59f7ebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0920a9a54d4d839f1e2125431e9d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:25.184165 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912e36b-b793-4d13-9551-031ad59f7ebc service cinder] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:25.184373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912e36b-b793-4d13-9551-031ad59f7ebc service cinder] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:25.184908 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912e36b-b793-4d13-9551-031ad59f7ebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:25.194437 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912e36b-b793-4d13-9551-031ad59f7ebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:25.195966 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912e36b-b793-4d13-9551-031ad59f7ebc service cinder] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:25.205940 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 490/997] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:25.504089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0ab07-399c-4bf4-a04f-f8afec500ce9 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:25.504458 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0ab07-399c-4bf4-a04f-f8afec500ce9 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:25.504648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0ab07-399c-4bf4-a04f-f8afec500ce9 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:25.506221 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 508/998] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:25.511675 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ec9be-a312-42a8-8e5d-8cb64100c795 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:25.511929 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ec9be-a312-42a8-8e5d-8cb64100c795 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:25.512453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ec9be-a312-42a8-8e5d-8cb64100c795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:25.531466 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-009ec9be-a312-42a8-8e5d-8cb64100c795 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:25.532707 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-009ec9be-a312-42a8-8e5d-8cb64100c795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:25.541946 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 491/999] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:25.587855 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0ab07-399c-4bf4-a04f-f8afec500ce9 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:25.602158 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0ab07-399c-4bf4-a04f-f8afec500ce9 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:25.607556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6016ff-d7cd-487c-88a8-283fc806d5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:25.608282 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6016ff-d7cd-487c-88a8-283fc806d5b6 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:25.608647 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6016ff-d7cd-487c-88a8-283fc806d5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:25.609036 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6016ff-d7cd-487c-88a8-283fc806d5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:25.618263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6016ff-d7cd-487c-88a8-283fc806d5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:25.619980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6016ff-d7cd-487c-88a8-283fc806d5b6 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:25.624940 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:40:25.633455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 509/1000] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:28.023951 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f1769-0025-4338-9e9d-9130448ea50d None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:28.024464 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f1769-0025-4338-9e9d-9130448ea50d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:28.024464 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f1769-0025-4338-9e9d-9130448ea50d None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:28.025880 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 492/1001] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:28.031201 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ef106-0efd-4180-b844-529f624bd2e9 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:28.031626 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ef106-0efd-4180-b844-529f624bd2e9 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:28.031741 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ef106-0efd-4180-b844-529f624bd2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:28.053278 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-e59ef106-0efd-4180-b844-529f624bd2e9 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:28.054495 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-e59ef106-0efd-4180-b844-529f624bd2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:28.064071 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 510/1002] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:28.108494 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f1769-0025-4338-9e9d-9130448ea50d None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:28.129142 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f1769-0025-4338-9e9d-9130448ea50d None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:28.135637 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c7df6-6bef-48b5-a205-df3ecf8e5937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:28.136407 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c7df6-6bef-48b5-a205-df3ecf8e5937 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:28.136762 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c7df6-6bef-48b5-a205-df3ecf8e5937 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:28.137152 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c7df6-6bef-48b5-a205-df3ecf8e5937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:28.147678 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c7df6-6bef-48b5-a205-df3ecf8e5937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:28.149450 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c7df6-6bef-48b5-a205-df3ecf8e5937 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:28.159971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 493/1003] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:30.479040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390b403-8aff-414a-a23a-d9841558783a None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:30.479623 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390b403-8aff-414a-a23a-d9841558783a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:30.479623 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390b403-8aff-414a-a23a-d9841558783a None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:30.480933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 511/1004] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:30.486477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7565d-f22f-4bb3-bc4d-7a8fa194179d None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:30.486908 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7565d-f22f-4bb3-bc4d-7a8fa194179d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:30.487000 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7565d-f22f-4bb3-bc4d-7a8fa194179d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:30.505255 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-fcb7565d-f22f-4bb3-bc4d-7a8fa194179d None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:30.506715 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-fcb7565d-f22f-4bb3-bc4d-7a8fa194179d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:30.516598 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 494/1005] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:30.558467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390b403-8aff-414a-a23a-d9841558783a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:30.573777 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390b403-8aff-414a-a23a-d9841558783a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:30.579523 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2b993-45a1-4a42-bccc-d8d5db700e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:30.580279 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2b993-45a1-4a42-bccc-d8d5db700e17 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:30.580646 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2b993-45a1-4a42-bccc-d8d5db700e17 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:30.581000 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2b993-45a1-4a42-bccc-d8d5db700e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:30.590008 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2b993-45a1-4a42-bccc-d8d5db700e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:30.591733 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2b993-45a1-4a42-bccc-d8d5db700e17 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:30.614544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 512/1006] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:32.946852 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e7e30-ceb7-4cd4-be02-8fe31bcb0d82 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:32.947630 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e7e30-ceb7-4cd4-be02-8fe31bcb0d82 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:32.948015 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e7e30-ceb7-4cd4-be02-8fe31bcb0d82 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:32.951337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 495/1007] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 25 20:40:32.956972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338d79-55e7-4521-864f-f11b9bb64cb5 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:32.957544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338d79-55e7-4521-864f-f11b9bb64cb5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:32.957544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338d79-55e7-4521-864f-f11b9bb64cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:32.977149 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-89338d79-55e7-4521-864f-f11b9bb64cb5 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:32.978357 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-89338d79-55e7-4521-864f-f11b9bb64cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:32.987301 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 513/1008] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:40:33.033029 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e7e30-ceb7-4cd4-be02-8fe31bcb0d82 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:33.047272 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e7e30-ceb7-4cd4-be02-8fe31bcb0d82 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:33.053668 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180514b-9db8-4f23-9629-42afd135a989 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:33.054453 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180514b-9db8-4f23-9629-42afd135a989 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:33.054834 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180514b-9db8-4f23-9629-42afd135a989 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:33.055476 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180514b-9db8-4f23-9629-42afd135a989 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:33.067965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180514b-9db8-4f23-9629-42afd135a989 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:33.070361 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180514b-9db8-4f23-9629-42afd135a989 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:33.084637 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 496/1009] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:35.484005 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76dc2f-bd68-4c06-be6f-6832dcd6f2d3 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:35.484654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76dc2f-bd68-4c06-be6f-6832dcd6f2d3 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:35.484654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76dc2f-bd68-4c06-be6f-6832dcd6f2d3 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:35.486547 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 514/1010] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:35.491879 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10123f5-b662-468d-808c-72140384ca7b None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:35.492505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10123f5-b662-468d-808c-72140384ca7b None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:35.492505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10123f5-b662-468d-808c-72140384ca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:35.511516 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-d10123f5-b662-468d-808c-72140384ca7b None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:35.512762 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-d10123f5-b662-468d-808c-72140384ca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:35.523896 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 497/1011] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:35.568199 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76dc2f-bd68-4c06-be6f-6832dcd6f2d3 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:35.583311 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76dc2f-bd68-4c06-be6f-6832dcd6f2d3 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:35.588982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff61582-57d4-4b35-9f95-451d7836ec84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:35.589636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff61582-57d4-4b35-9f95-451d7836ec84 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:35.589950 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff61582-57d4-4b35-9f95-451d7836ec84 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:35.590208 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff61582-57d4-4b35-9f95-451d7836ec84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:35.599794 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff61582-57d4-4b35-9f95-451d7836ec84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:35.601419 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff61582-57d4-4b35-9f95-451d7836ec84 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:35.611609 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 515/1012] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:38.346811 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1232-0869-41fe-bfba-679d5c7336ba None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:38.347951 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1232-0869-41fe-bfba-679d5c7336ba None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:38.347951 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbc1232-0869-41fe-bfba-679d5c7336ba None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:38.349085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 498/1013] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:38.355178 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e486-c141-4b3a-a19b-654957195b91 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:38.355715 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e486-c141-4b3a-a19b-654957195b91 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:38.355877 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1e486-c141-4b3a-a19b-654957195b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:38.384330 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-8ae1e486-c141-4b3a-a19b-654957195b91 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:38.385546 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-8ae1e486-c141-4b3a-a19b-654957195b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:38.395086 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 516/1014] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:38.442703 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc1232-0869-41fe-bfba-679d5c7336ba None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:38.457887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbc1232-0869-41fe-bfba-679d5c7336ba None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:38.463387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02afc4-3e30-4b1a-88c2-b6704ee4309b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:38.464038 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02afc4-3e30-4b1a-88c2-b6704ee4309b service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:38.464322 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02afc4-3e30-4b1a-88c2-b6704ee4309b service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:38.464634 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02afc4-3e30-4b1a-88c2-b6704ee4309b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:38.474623 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02afc4-3e30-4b1a-88c2-b6704ee4309b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:38.476258 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e02afc4-3e30-4b1a-88c2-b6704ee4309b service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:38.486646 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 499/1015] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:41.055460 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92136cd-27dc-4bf8-af45-05f3453849bd None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:41.056149 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92136cd-27dc-4bf8-af45-05f3453849bd None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:41.056149 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92136cd-27dc-4bf8-af45-05f3453849bd None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:41.057404 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 517/1016] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:41.063476 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fbb7a-7e2e-4067-a565-2adbb4c65de3 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:41.064097 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fbb7a-7e2e-4067-a565-2adbb4c65de3 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:41.064097 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fbb7a-7e2e-4067-a565-2adbb4c65de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:41.071106 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=52 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:40:41.085959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-9e0fbb7a-7e2e-4067-a565-2adbb4c65de3 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:41.087210 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-9e0fbb7a-7e2e-4067-a565-2adbb4c65de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:41.096619 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 500/1017] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:41.142176 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92136cd-27dc-4bf8-af45-05f3453849bd None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:41.156940 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92136cd-27dc-4bf8-af45-05f3453849bd None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:41.163135 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a6c39-9c5d-4d90-8d99-8625281a4de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:41.163786 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a6c39-9c5d-4d90-8d99-8625281a4de1 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:41.164064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a6c39-9c5d-4d90-8d99-8625281a4de1 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:41.164320 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a6c39-9c5d-4d90-8d99-8625281a4de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:41.174196 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a6c39-9c5d-4d90-8d99-8625281a4de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:41.175870 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a6c39-9c5d-4d90-8d99-8625281a4de1 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:41.186049 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 518/1018] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:41.299665 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e0714-53ea-4230-9df1-13eac7e688c1 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:41.299935 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e0714-53ea-4230-9df1-13eac7e688c1 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:41.300237 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e0714-53ea-4230-9df1-13eac7e688c1 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:41.301798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 501/1019] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:41.307506 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52c091-12ec-4674-a215-68488382e1a9 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:41.307772 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52c091-12ec-4674-a215-68488382e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:41.308114 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52c091-12ec-4674-a215-68488382e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:41.327250 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-2f52c091-12ec-4674-a215-68488382e1a9 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:41.328493 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-2f52c091-12ec-4674-a215-68488382e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:41.336952 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 519/1020] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:41.398153 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90831826-5c07-4b70-8d86-1834f3d5a48d None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:41.398459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90831826-5c07-4b70-8d86-1834f3d5a48d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:41.398753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90831826-5c07-4b70-8d86-1834f3d5a48d None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:41.400135 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 502/1021] 10.222.0.26 () {54 vars in 962 bytes} [Sat Jun 25 20:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:41.406082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd278d-9a25-4e79-be9f-b5f2f4e604bc None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:41.406369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd278d-9a25-4e79-be9f-b5f2f4e604bc None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:41.406682 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd278d-9a25-4e79-be9f-b5f2f4e604bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:41.447444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-5edd278d-9a25-4e79-be9f-b5f2f4e604bc None None] MFA Rules not processed for user `7e58f00fa06e4a1ca16f5f8eba3dfb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:41.448543 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-5edd278d-9a25-4e79-be9f-b5f2f4e604bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:41.508827 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 520/1022] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Jun 25 20:40:41 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:41.516427 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90831826-5c07-4b70-8d86-1834f3d5a48d None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:41.528463 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90831826-5c07-4b70-8d86-1834f3d5a48d None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:41.532333 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41020356-1b34-40a7-b1b4-67c26bbc86b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e58f00fa06e4a1ca16f5f8eba3dfb0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:41.532971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41020356-1b34-40a7-b1b4-67c26bbc86b3 service glance] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:41.533256 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41020356-1b34-40a7-b1b4-67c26bbc86b3 service glance] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:41.533533 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41020356-1b34-40a7-b1b4-67c26bbc86b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:41.543144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41020356-1b34-40a7-b1b4-67c26bbc86b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:41.544637 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41020356-1b34-40a7-b1b4-67c26bbc86b3 service glance] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:41.554693 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 503/1023] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:43.532547 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e63983-6453-4ec2-a2d5-f31bc1e8954a None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:43.533232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e63983-6453-4ec2-a2d5-f31bc1e8954a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:43.533232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e63983-6453-4ec2-a2d5-f31bc1e8954a None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:43.534677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 521/1024] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:43.540210 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd5e48-390a-48cc-8f79-2b0586378d97 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:43.540712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd5e48-390a-48cc-8f79-2b0586378d97 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:43.540815 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd5e48-390a-48cc-8f79-2b0586378d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:43.560415 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-12cd5e48-390a-48cc-8f79-2b0586378d97 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:43.561685 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-12cd5e48-390a-48cc-8f79-2b0586378d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:43.571395 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 504/1025] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:40:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:43.620025 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e63983-6453-4ec2-a2d5-f31bc1e8954a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:43.637112 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e63983-6453-4ec2-a2d5-f31bc1e8954a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:43.643453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae64c1-da6c-408a-8904-767a6fea69ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:43.644115 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae64c1-da6c-408a-8904-767a6fea69ab service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:43.644464 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae64c1-da6c-408a-8904-767a6fea69ab service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:43.644672 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae64c1-da6c-408a-8904-767a6fea69ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:43.658059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae64c1-da6c-408a-8904-767a6fea69ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:40:43.658059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae64c1-da6c-408a-8904-767a6fea69ab service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:40:43.666430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 522/1026] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:40:53.554448 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=11 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:40:53.661791 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=70 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:40:56.985540 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3addcd-b9a8-408f-a9d4-110fef926ca7 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:56.986218 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3addcd-b9a8-408f-a9d4-110fef926ca7 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:56.986218 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3addcd-b9a8-408f-a9d4-110fef926ca7 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:56.987511 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 505/1027] 10.222.0.26 () {54 vars in 918 bytes} [Sat Jun 25 20:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:56.993267 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c195358-4555-480c-8053-50991ea17ecb None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:56.993832 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c195358-4555-480c-8053-50991ea17ecb None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:56.993832 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c195358-4555-480c-8053-50991ea17ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:57.015528 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-8c195358-4555-480c-8053-50991ea17ecb None None] MFA Rules not processed for user `d91c64b1ed4e49c7870ac00844b29bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:57.016798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-8c195358-4555-480c-8053-50991ea17ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:57.026792 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 523/1028] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Jun 25 20:40:56 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:57.042510 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5afb18-c5eb-4915-9340-70a9845f11c9 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:57.042809 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5afb18-c5eb-4915-9340-70a9845f11c9 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:57.043089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5afb18-c5eb-4915-9340-70a9845f11c9 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:57.045054 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 506/1029] 10.222.0.26 () {54 vars in 918 bytes} [Sat Jun 25 20:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:57.050156 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebdc47-0830-4851-8e56-cb12e793d63f None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:57.050490 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebdc47-0830-4851-8e56-cb12e793d63f None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:57.050774 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebdc47-0830-4851-8e56-cb12e793d63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:57.073158 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-50ebdc47-0830-4851-8e56-cb12e793d63f None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:57.074390 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-50ebdc47-0830-4851-8e56-cb12e793d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:57.083508 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 524/1030] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Jun 25 20:40:57 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:59.882634 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e114-32d3-4503-b407-97757423df38 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:59.883582 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e114-32d3-4503-b407-97757423df38 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:59.883582 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e114-32d3-4503-b407-97757423df38 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:59.885780 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 507/1031] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:40:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:40:59.892080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871b6f6-f620-496a-a84c-533b9adc3cc2 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:59.892853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871b6f6-f620-496a-a84c-533b9adc3cc2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:59.892853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871b6f6-f620-496a-a84c-533b9adc3cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:40:59.919529 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-6871b6f6-f620-496a-a84c-533b9adc3cc2 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:40:59.920734 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-6871b6f6-f620-496a-a84c-533b9adc3cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:40:59.929965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 525/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:40:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:40:59.974756 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e114-32d3-4503-b407-97757423df38 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:40:59.990097 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e114-32d3-4503-b407-97757423df38 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:40:59.995334 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec668b-ed50-4381-9489-7851472cfef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:40:59.995977 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec668b-ed50-4381-9489-7851472cfef3 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:40:59.996267 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec668b-ed50-4381-9489-7851472cfef3 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:40:59.996553 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec668b-ed50-4381-9489-7851472cfef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:00.005319 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec668b-ed50-4381-9489-7851472cfef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:00.006982 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec668b-ed50-4381-9489-7851472cfef3 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:00.016676 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 508/1033] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:40:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:00.988143 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5ba10-0e79-4cec-a449-701663c85470 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:00.988883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5ba10-0e79-4cec-a449-701663c85470 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:00.989067 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a5ba10-0e79-4cec-a449-701663c85470 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:00.991313 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 526/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:41:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:00.999270 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eaae8-3939-4f03-88c8-dfc782663922 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:00.999760 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eaae8-3939-4f03-88c8-dfc782663922 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:00.999865 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eaae8-3939-4f03-88c8-dfc782663922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:01.021261 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-e57eaae8-3939-4f03-88c8-dfc782663922 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:01.023126 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-e57eaae8-3939-4f03-88c8-dfc782663922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:01.034812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 509/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:41:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:01.244786 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5ba10-0e79-4cec-a449-701663c85470 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:01.260790 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a5ba10-0e79-4cec-a449-701663c85470 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:01.267671 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30869f-bc0a-415d-953b-6907ab5ff704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:01.268316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30869f-bc0a-415d-953b-6907ab5ff704 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:01.268594 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30869f-bc0a-415d-953b-6907ab5ff704 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:01.268865 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30869f-bc0a-415d-953b-6907ab5ff704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:01.277451 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30869f-bc0a-415d-953b-6907ab5ff704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:01.279116 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30869f-bc0a-415d-953b-6907ab5ff704 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:01.288766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 527/1036] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:41:02.199337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b47cf-dfb3-4612-a4d1-12091c2373d9 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:02.200182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b47cf-dfb3-4612-a4d1-12091c2373d9 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:02.200182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b47cf-dfb3-4612-a4d1-12091c2373d9 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:02.202207 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 510/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:41:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:02.207209 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d11a-28a6-4bae-93e6-48bcedca7527 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:02.207652 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d11a-28a6-4bae-93e6-48bcedca7527 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:02.207754 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3d11a-28a6-4bae-93e6-48bcedca7527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:02.226882 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-eaf3d11a-28a6-4bae-93e6-48bcedca7527 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:02.228077 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-eaf3d11a-28a6-4bae-93e6-48bcedca7527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:02.236954 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 528/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:41:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:02.394484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b47cf-dfb3-4612-a4d1-12091c2373d9 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:02.411221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b47cf-dfb3-4612-a4d1-12091c2373d9 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:02.416931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e2882-3dc8-4a1b-93e5-35c3a3d47831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:02.417798 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2882-3dc8-4a1b-93e5-35c3a3d47831 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:02.418092 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2882-3dc8-4a1b-93e5-35c3a3d47831 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:02.418372 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2882-3dc8-4a1b-93e5-35c3a3d47831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:02.427898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e2882-3dc8-4a1b-93e5-35c3a3d47831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:02.429539 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e2882-3dc8-4a1b-93e5-35c3a3d47831 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:02.439605 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 511/1039] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:41:03.295449 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b775e-5420-49ef-b9bd-4db8c2c5c4e7 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:03.296342 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b775e-5420-49ef-b9bd-4db8c2c5c4e7 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:03.296512 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b775e-5420-49ef-b9bd-4db8c2c5c4e7 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:03.298630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 529/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:41:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:03.304528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da18270-927a-4aa8-b3d8-c3725de07723 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:03.305249 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da18270-927a-4aa8-b3d8-c3725de07723 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:03.305438 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da18270-927a-4aa8-b3d8-c3725de07723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:03.326677 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-8da18270-927a-4aa8-b3d8-c3725de07723 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:03.327933 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-8da18270-927a-4aa8-b3d8-c3725de07723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:03.336344 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 512/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:41:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:03.491871 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b775e-5420-49ef-b9bd-4db8c2c5c4e7 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:03.515430 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b775e-5420-49ef-b9bd-4db8c2c5c4e7 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:03.521816 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36c9cb-ee64-4fc5-9ef3-467b60694934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:03.522448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36c9cb-ee64-4fc5-9ef3-467b60694934 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:03.522766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36c9cb-ee64-4fc5-9ef3-467b60694934 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:03.523038 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36c9cb-ee64-4fc5-9ef3-467b60694934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:03.531986 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36c9cb-ee64-4fc5-9ef3-467b60694934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:03.533589 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36c9cb-ee64-4fc5-9ef3-467b60694934 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:03.543159 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 530/1042] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:04.411983 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d8aaf-56d7-4c9e-97eb-a766cc13053f None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:04.412581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d8aaf-56d7-4c9e-97eb-a766cc13053f None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:04.412581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d8aaf-56d7-4c9e-97eb-a766cc13053f None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:04.413994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 513/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:04.420266 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01771955-1554-4a13-81e6-82d4448fd9ed None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:04.420937 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01771955-1554-4a13-81e6-82d4448fd9ed None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:04.421210 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01771955-1554-4a13-81e6-82d4448fd9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:04.441521 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-01771955-1554-4a13-81e6-82d4448fd9ed None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:04.442784 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-01771955-1554-4a13-81e6-82d4448fd9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:04.453160 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 531/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:41:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:04.615909 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d8aaf-56d7-4c9e-97eb-a766cc13053f None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:04.634581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d8aaf-56d7-4c9e-97eb-a766cc13053f None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:04.641003 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d2bee-2b61-479e-ac0b-d437cfa69b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:04.641698 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d2bee-2b61-479e-ac0b-d437cfa69b92 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:04.641990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d2bee-2b61-479e-ac0b-d437cfa69b92 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:04.642269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d2bee-2b61-479e-ac0b-d437cfa69b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:04.651496 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d2bee-2b61-479e-ac0b-d437cfa69b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:04.653090 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d2bee-2b61-479e-ac0b-d437cfa69b92 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:04.662820 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 514/1045] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:05.464908 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a944a-405a-4393-a1fc-0de51b14ae24 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:05.465684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a944a-405a-4393-a1fc-0de51b14ae24 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:05.465826 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a944a-405a-4393-a1fc-0de51b14ae24 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:05.467861 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 532/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:41:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:05.473534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c13e0f-eaf2-411e-b56d-3e07befdd002 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:05.473999 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c13e0f-eaf2-411e-b56d-3e07befdd002 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:05.474093 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c13e0f-eaf2-411e-b56d-3e07befdd002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:05.493149 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-48c13e0f-eaf2-411e-b56d-3e07befdd002 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:05.494345 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-48c13e0f-eaf2-411e-b56d-3e07befdd002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:05.503189 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 515/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:41:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:41:05.664305 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a944a-405a-4393-a1fc-0de51b14ae24 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:05.682787 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a944a-405a-4393-a1fc-0de51b14ae24 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:05.687871 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291345e0-2364-4940-9aa0-324e0d07edb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:05.688509 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291345e0-2364-4940-9aa0-324e0d07edb0 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:05.688798 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291345e0-2364-4940-9aa0-324e0d07edb0 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:05.689075 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291345e0-2364-4940-9aa0-324e0d07edb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:05.697724 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291345e0-2364-4940-9aa0-324e0d07edb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:05.699386 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291345e0-2364-4940-9aa0-324e0d07edb0 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:05.708851 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 533/1048] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:06.511355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fa037-5088-49b3-9818-a76ade7bb0c8 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:06.511885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fa037-5088-49b3-9818-a76ade7bb0c8 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:06.511885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fa037-5088-49b3-9818-a76ade7bb0c8 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:06.513292 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 516/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:06.519413 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa573-74c4-493d-a74b-953b0e4f5a0b None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:06.519858 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa573-74c4-493d-a74b-953b0e4f5a0b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:06.519987 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3fa573-74c4-493d-a74b-953b0e4f5a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:06.549272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-2c3fa573-74c4-493d-a74b-953b0e4f5a0b None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:06.550503 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-2c3fa573-74c4-493d-a74b-953b0e4f5a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:06.564246 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 534/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:41:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:06.721630 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fa037-5088-49b3-9818-a76ade7bb0c8 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:06.741855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fa037-5088-49b3-9818-a76ade7bb0c8 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:06.748164 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dad143-61e6-4f4c-b8d1-2a1f70708e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:06.749198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad143-61e6-4f4c-b8d1-2a1f70708e03 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:06.749490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad143-61e6-4f4c-b8d1-2a1f70708e03 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:06.749774 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dad143-61e6-4f4c-b8d1-2a1f70708e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:06.761770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad143-61e6-4f4c-b8d1-2a1f70708e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:06.763762 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dad143-61e6-4f4c-b8d1-2a1f70708e03 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:06.777073 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 517/1051] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:07.574806 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aef6c-0b98-4590-a952-200c10bdcb2d None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:07.575655 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aef6c-0b98-4590-a952-200c10bdcb2d None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:07.575655 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421aef6c-0b98-4590-a952-200c10bdcb2d None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:07.577890 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 535/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:41:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:07.586272 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a6ec6-fa67-4bb8-bd33-a06de026425f None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:07.586742 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a6ec6-fa67-4bb8-bd33-a06de026425f None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:07.586888 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a6ec6-fa67-4bb8-bd33-a06de026425f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:07.608741 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-387a6ec6-fa67-4bb8-bd33-a06de026425f None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:07.609958 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-387a6ec6-fa67-4bb8-bd33-a06de026425f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:07.618320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 518/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:41:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:07.774782 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aef6c-0b98-4590-a952-200c10bdcb2d None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:07.789256 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421aef6c-0b98-4590-a952-200c10bdcb2d None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:07.795046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea23048-0069-45fd-8127-eb1c821facd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:07.795730 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea23048-0069-45fd-8127-eb1c821facd4 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:07.796005 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea23048-0069-45fd-8127-eb1c821facd4 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:07.796281 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea23048-0069-45fd-8127-eb1c821facd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:07.809486 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea23048-0069-45fd-8127-eb1c821facd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:07.811638 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea23048-0069-45fd-8127-eb1c821facd4 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:07.821473 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 536/1054] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:08.632212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fa3d-c120-4448-9e77-18444983dfb2 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:08.633121 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fa3d-c120-4448-9e77-18444983dfb2 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:08.633297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c505fa3d-c120-4448-9e77-18444983dfb2 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:08.635440 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 519/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:41:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:08.640665 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2ad7a-b604-4c01-9093-4e0336506cf9 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:08.641138 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2ad7a-b604-4c01-9093-4e0336506cf9 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:08.641250 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2ad7a-b604-4c01-9093-4e0336506cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:08.660491 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-ade2ad7a-b604-4c01-9093-4e0336506cf9 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:08.661693 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-ade2ad7a-b604-4c01-9093-4e0336506cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:08.669834 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 537/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:41:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:08.825650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505fa3d-c120-4448-9e77-18444983dfb2 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:08.845344 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c505fa3d-c120-4448-9e77-18444983dfb2 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:08.854838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d00a7-8d67-4f9a-ab47-1f4c9983beca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:08.855753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d00a7-8d67-4f9a-ab47-1f4c9983beca service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:08.856103 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d00a7-8d67-4f9a-ab47-1f4c9983beca service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:08.856479 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d00a7-8d67-4f9a-ab47-1f4c9983beca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:08.866081 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d00a7-8d67-4f9a-ab47-1f4c9983beca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:08.867729 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d00a7-8d67-4f9a-ab47-1f4c9983beca service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:08.877667 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 520/1057] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:11.020936 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88928ba-be13-424e-94db-0cc5876e920f None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:11.021517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88928ba-be13-424e-94db-0cc5876e920f None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:11.021517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88928ba-be13-424e-94db-0cc5876e920f None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:11.022920 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 538/1058] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:11.029205 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126ac8d-a6ae-430a-8e5a-b80778c1b7eb None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:11.030045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126ac8d-a6ae-430a-8e5a-b80778c1b7eb None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:11.030590 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126ac8d-a6ae-430a-8e5a-b80778c1b7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:11.054290 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-3126ac8d-a6ae-430a-8e5a-b80778c1b7eb None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:11.055532 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-3126ac8d-a6ae-430a-8e5a-b80778c1b7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:11.064583 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 521/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:11.104051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88928ba-be13-424e-94db-0cc5876e920f None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:11.117314 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88928ba-be13-424e-94db-0cc5876e920f None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:11.121488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb241f9-fa8a-4ab7-a4a2-cc4f5d136cf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:11.122130 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb241f9-fa8a-4ab7-a4a2-cc4f5d136cf7 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:11.122452 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb241f9-fa8a-4ab7-a4a2-cc4f5d136cf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:11.122741 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb241f9-fa8a-4ab7-a4a2-cc4f5d136cf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:11.132209 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb241f9-fa8a-4ab7-a4a2-cc4f5d136cf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:11.133648 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb241f9-fa8a-4ab7-a4a2-cc4f5d136cf7 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:11.143747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 539/1060] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:13.609997 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbece-1fc3-44ed-8026-e0b4c39f5641 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:13.610607 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbece-1fc3-44ed-8026-e0b4c39f5641 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:13.610607 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8dbece-1fc3-44ed-8026-e0b4c39f5641 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:13.611936 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 522/1061] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:13.618469 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b44a1-0ed9-4144-9288-38df927639c5 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:13.618908 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b44a1-0ed9-4144-9288-38df927639c5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:13.619003 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b44a1-0ed9-4144-9288-38df927639c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:13.640556 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-435b44a1-0ed9-4144-9288-38df927639c5 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:13.641764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-435b44a1-0ed9-4144-9288-38df927639c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:13.650944 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 540/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:13.690052 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dbece-1fc3-44ed-8026-e0b4c39f5641 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:13.709012 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8dbece-1fc3-44ed-8026-e0b4c39f5641 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:13.714393 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17345ce9-2a77-4b2f-a6a8-546e796b1fd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:13.715068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17345ce9-2a77-4b2f-a6a8-546e796b1fd0 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:13.715347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17345ce9-2a77-4b2f-a6a8-546e796b1fd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:13.715624 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17345ce9-2a77-4b2f-a6a8-546e796b1fd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:13.725352 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17345ce9-2a77-4b2f-a6a8-546e796b1fd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:13.726871 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17345ce9-2a77-4b2f-a6a8-546e796b1fd0 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:13.736296 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 523/1063] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:16.370796 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78806964-c51f-4c00-9ed9-6ff15e4cc2d5 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:16.371374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78806964-c51f-4c00-9ed9-6ff15e4cc2d5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:16.371374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78806964-c51f-4c00-9ed9-6ff15e4cc2d5 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:16.372758 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 541/1064] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:16.379504 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423800-5d9e-4e69-9280-e22dbcb17677 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:16.380272 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423800-5d9e-4e69-9280-e22dbcb17677 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:16.380392 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423800-5d9e-4e69-9280-e22dbcb17677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:16.402569 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-4c423800-5d9e-4e69-9280-e22dbcb17677 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:16.403762 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-4c423800-5d9e-4e69-9280-e22dbcb17677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:16.413088 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 524/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:16.455844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78806964-c51f-4c00-9ed9-6ff15e4cc2d5 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:16.473829 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78806964-c51f-4c00-9ed9-6ff15e4cc2d5 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:16.480082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789b573-edb6-4fb3-8a46-8d2be1866cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:16.481053 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789b573-edb6-4fb3-8a46-8d2be1866cca service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:16.481467 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789b573-edb6-4fb3-8a46-8d2be1866cca service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:16.481838 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789b573-edb6-4fb3-8a46-8d2be1866cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:16.491941 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789b573-edb6-4fb3-8a46-8d2be1866cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:16.493399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789b573-edb6-4fb3-8a46-8d2be1866cca service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:16.503039 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 542/1066] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:18.897679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e1bf-5aed-4430-8b78-a82eae5a8e89 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:18.898522 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e1bf-5aed-4430-8b78-a82eae5a8e89 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:18.898522 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76e1bf-5aed-4430-8b78-a82eae5a8e89 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:18.900616 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 525/1067] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:18.909757 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98160c-060b-4951-ae00-2b2ccb3cb860 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:18.910230 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98160c-060b-4951-ae00-2b2ccb3cb860 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:18.910338 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98160c-060b-4951-ae00-2b2ccb3cb860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:18.931324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-ba98160c-060b-4951-ae00-2b2ccb3cb860 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:18.932538 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-ba98160c-060b-4951-ae00-2b2ccb3cb860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:18.941789 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 543/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:18.983838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e1bf-5aed-4430-8b78-a82eae5a8e89 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:18.997276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba76e1bf-5aed-4430-8b78-a82eae5a8e89 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:19.002097 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7906703-a356-4b74-b0cf-02f12bb5703a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:19.002773 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7906703-a356-4b74-b0cf-02f12bb5703a service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:19.003056 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7906703-a356-4b74-b0cf-02f12bb5703a service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:19.003332 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7906703-a356-4b74-b0cf-02f12bb5703a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:19.012753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7906703-a356-4b74-b0cf-02f12bb5703a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:19.014348 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7906703-a356-4b74-b0cf-02f12bb5703a service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:19.023904 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 526/1069] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:21.370535 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1d4e-0c2e-4898-a8d1-d3191e02ab72 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:21.371106 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1d4e-0c2e-4898-a8d1-d3191e02ab72 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:21.371106 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb1d4e-0c2e-4898-a8d1-d3191e02ab72 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:21.372442 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 544/1070] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:21.379054 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcffca1-004e-487e-9491-9e168a27e89d None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:21.379495 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcffca1-004e-487e-9491-9e168a27e89d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:21.379632 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcffca1-004e-487e-9491-9e168a27e89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:21.403570 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-2bcffca1-004e-487e-9491-9e168a27e89d None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:21.404837 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-2bcffca1-004e-487e-9491-9e168a27e89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:21.414309 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 527/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:21.453391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1d4e-0c2e-4898-a8d1-d3191e02ab72 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:21.469505 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb1d4e-0c2e-4898-a8d1-d3191e02ab72 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:21.473748 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3396a1-28ed-42e7-92cf-a166737dd348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:21.474474 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3396a1-28ed-42e7-92cf-a166737dd348 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:21.474765 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3396a1-28ed-42e7-92cf-a166737dd348 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:21.475043 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3396a1-28ed-42e7-92cf-a166737dd348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:21.486695 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3396a1-28ed-42e7-92cf-a166737dd348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:21.488157 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3396a1-28ed-42e7-92cf-a166737dd348 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:21.499894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 545/1072] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:23.885263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff892-6ab6-4939-b9b0-93b3b4472500 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:23.886155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff892-6ab6-4939-b9b0-93b3b4472500 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:23.886155 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff892-6ab6-4939-b9b0-93b3b4472500 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:23.888300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 528/1073] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:23.894586 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9a2ed-3484-4031-9268-eb62a14ab78a None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:23.895026 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9a2ed-3484-4031-9268-eb62a14ab78a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:23.895117 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9a2ed-3484-4031-9268-eb62a14ab78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:23.901535 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=70 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:23.915629 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-7fb9a2ed-3484-4031-9268-eb62a14ab78a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:23.916818 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-7fb9a2ed-3484-4031-9268-eb62a14ab78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:23.926270 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 546/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:41:23.965674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dff892-6ab6-4939-b9b0-93b3b4472500 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:23.971394 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=64 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:23.978178 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dff892-6ab6-4939-b9b0-93b3b4472500 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:23.981650 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec1306-1830-427d-9e07-3f2bccca650d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:23.982287 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec1306-1830-427d-9e07-3f2bccca650d service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:23.982660 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec1306-1830-427d-9e07-3f2bccca650d service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:23.982947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec1306-1830-427d-9e07-3f2bccca650d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:23.991704 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec1306-1830-427d-9e07-3f2bccca650d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:23.993140 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec1306-1830-427d-9e07-3f2bccca650d service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:24.002923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 529/1075] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:26.392137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c629-336f-478a-a10e-acc3391528fc None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:26.392707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c629-336f-478a-a10e-acc3391528fc None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:26.392707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26c629-336f-478a-a10e-acc3391528fc None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:26.394046 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 547/1076] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:26.400347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effb565-6473-4747-b0a0-d46e90c46b61 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:26.401063 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effb565-6473-4747-b0a0-d46e90c46b61 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:26.401154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effb565-6473-4747-b0a0-d46e90c46b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:26.421089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-8effb565-6473-4747-b0a0-d46e90c46b61 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:26.422329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-8effb565-6473-4747-b0a0-d46e90c46b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:26.431666 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 530/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:26.472242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26c629-336f-478a-a10e-acc3391528fc None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:26.484291 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26c629-336f-478a-a10e-acc3391528fc None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:26.488433 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3c150-c6f5-4f43-a4e0-3838124969e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:26.489081 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3c150-c6f5-4f43-a4e0-3838124969e2 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:26.489367 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3c150-c6f5-4f43-a4e0-3838124969e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:26.489641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3c150-c6f5-4f43-a4e0-3838124969e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:26.498999 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3c150-c6f5-4f43-a4e0-3838124969e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:26.500502 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3c150-c6f5-4f43-a4e0-3838124969e2 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:26.509952 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 548/1078] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:28.822873 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dbb55-32a0-439c-8d0a-25a1ba084d70 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:28.823829 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dbb55-32a0-439c-8d0a-25a1ba084d70 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:28.823829 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7dbb55-32a0-439c-8d0a-25a1ba084d70 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:28.825950 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 531/1079] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:28.831475 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca1c17-2c6f-4b06-aee2-6fd513e56e02 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:28.831919 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca1c17-2c6f-4b06-aee2-6fd513e56e02 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:28.832032 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca1c17-2c6f-4b06-aee2-6fd513e56e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:28.851441 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-7dca1c17-2c6f-4b06-aee2-6fd513e56e02 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:28.852635 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-7dca1c17-2c6f-4b06-aee2-6fd513e56e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:28.861084 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 549/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:28.903002 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dbb55-32a0-439c-8d0a-25a1ba084d70 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:28.923581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7dbb55-32a0-439c-8d0a-25a1ba084d70 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:28.932664 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43f85f-92f4-46b3-ac2f-4063ea67f106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:28.933411 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43f85f-92f4-46b3-ac2f-4063ea67f106 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:28.934224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43f85f-92f4-46b3-ac2f-4063ea67f106 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:28.934224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43f85f-92f4-46b3-ac2f-4063ea67f106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:28.950273 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43f85f-92f4-46b3-ac2f-4063ea67f106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:28.951894 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43f85f-92f4-46b3-ac2f-4063ea67f106 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:28.964568 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 532/1081] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:31.275415 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cacebc-b029-4ff4-8101-15ac7e093a8a None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:31.276306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cacebc-b029-4ff4-8101-15ac7e093a8a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:31.276306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cacebc-b029-4ff4-8101-15ac7e093a8a None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:31.278367 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 550/1082] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:31.284692 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee5fcb-f375-4842-90c0-36b79ec7407a None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:31.285429 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee5fcb-f375-4842-90c0-36b79ec7407a None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:31.285635 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee5fcb-f375-4842-90c0-36b79ec7407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:31.308225 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-ccee5fcb-f375-4842-90c0-36b79ec7407a None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:31.309424 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-ccee5fcb-f375-4842-90c0-36b79ec7407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:31.318855 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 533/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:31.356396 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cacebc-b029-4ff4-8101-15ac7e093a8a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:31.369180 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cacebc-b029-4ff4-8101-15ac7e093a8a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:31.374195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4a0f9-7130-4f65-8a32-3f102e8f78fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:31.374661 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a0f9-7130-4f65-8a32-3f102e8f78fe service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:31.374951 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a0f9-7130-4f65-8a32-3f102e8f78fe service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:31.375210 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4a0f9-7130-4f65-8a32-3f102e8f78fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:31.386225 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4a0f9-7130-4f65-8a32-3f102e8f78fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:31.387711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4a0f9-7130-4f65-8a32-3f102e8f78fe service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:31.397319 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 551/1084] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:33.686730 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d2b65-e63d-4b0e-8b2d-a196f0ac0f96 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:33.687282 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d2b65-e63d-4b0e-8b2d-a196f0ac0f96 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:33.687282 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1d2b65-e63d-4b0e-8b2d-a196f0ac0f96 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:33.688564 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 534/1085] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:41:33.694237 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4b611-ab49-491d-8e4c-4eae705b0e3e None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:33.694713 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4b611-ab49-491d-8e4c-4eae705b0e3e None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:33.694807 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4b611-ab49-491d-8e4c-4eae705b0e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:33.719305 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-edc4b611-ab49-491d-8e4c-4eae705b0e3e None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:41:33.721031 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-edc4b611-ab49-491d-8e4c-4eae705b0e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:41:33.733323 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 552/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:41:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:41:33.782184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d2b65-e63d-4b0e-8b2d-a196f0ac0f96 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:41:33.793586 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1d2b65-e63d-4b0e-8b2d-a196f0ac0f96 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:41:33.797472 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7d9c1-7aa0-41ef-9101-69d2872e6ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:41:33.798104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d9c1-7aa0-41ef-9101-69d2872e6ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:41:33.798388 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d9c1-7aa0-41ef-9101-69d2872e6ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:41:33.798768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d9c1-7aa0-41ef-9101-69d2872e6ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:41:33.807902 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7d9c1-7aa0-41ef-9101-69d2872e6ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:41:33.809335 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7d9c1-7aa0-41ef-9101-69d2872e6ff8 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:41:33.819325 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 535/1087] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:41:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:41:43.712096 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=20 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:41:43.814752 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=23 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:10.379637 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03b8e-b2bf-482c-95b3-01d9dfaa17bf None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:10.380563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03b8e-b2bf-482c-95b3-01d9dfaa17bf None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:10.380563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03b8e-b2bf-482c-95b3-01d9dfaa17bf None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:10.382790 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 553/1088] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:10.389060 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981b34b-6e3b-4933-982e-40dc7b8e3dc5 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:10.389583 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981b34b-6e3b-4933-982e-40dc7b8e3dc5 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:10.389583 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981b34b-6e3b-4933-982e-40dc7b8e3dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:10.408224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-9981b34b-6e3b-4933-982e-40dc7b8e3dc5 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:10.409420 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-9981b34b-6e3b-4933-982e-40dc7b8e3dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:10.418177 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 536/1089] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:10.469042 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ace4d-ad3c-4502-90a8-f6f97bf84f55 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:10.469331 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ace4d-ad3c-4502-90a8-f6f97bf84f55 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:10.469610 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ace4d-ad3c-4502-90a8-f6f97bf84f55 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:10.471114 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 554/1090] 10.222.0.26 () {54 vars in 962 bytes} [Sat Jun 25 20:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:10.476905 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851ee48-ceb8-4824-babe-568e16f42a66 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:10.477198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851ee48-ceb8-4824-babe-568e16f42a66 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:10.477484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851ee48-ceb8-4824-babe-568e16f42a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:10.500289 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-d851ee48-ceb8-4824-babe-568e16f42a66 None None] MFA Rules not processed for user `7e58f00fa06e4a1ca16f5f8eba3dfb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:10.501416 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-d851ee48-ceb8-4824-babe-568e16f42a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:10.509441 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 537/1091] 10.222.0.26 () {58 vars in 1059 bytes} [Sat Jun 25 20:42:10 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:42:10.517272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ace4d-ad3c-4502-90a8-f6f97bf84f55 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:10.530753 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ace4d-ad3c-4502-90a8-f6f97bf84f55 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:10.535121 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b8a540-c9a9-49ed-b06c-3a536c7ada4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e58f00fa06e4a1ca16f5f8eba3dfb0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:10.535766 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8a540-c9a9-49ed-b06c-3a536c7ada4c service glance] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:10.536055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8a540-c9a9-49ed-b06c-3a536c7ada4c service glance] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:10.536335 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8a540-c9a9-49ed-b06c-3a536c7ada4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:10.546227 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8a540-c9a9-49ed-b06c-3a536c7ada4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:10.547708 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b8a540-c9a9-49ed-b06c-3a536c7ada4c service glance] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:10.557569 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 555/1092] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:12.981355 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a012dc-b802-43d5-98fc-9ec0dbeb9336 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:12.981941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a012dc-b802-43d5-98fc-9ec0dbeb9336 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:12.981941 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a012dc-b802-43d5-98fc-9ec0dbeb9336 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:12.983854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 538/1093] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:12.990339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c567-48a2-44b4-9e2d-9d71b1436199 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:12.991067 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c567-48a2-44b4-9e2d-9d71b1436199 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:12.991352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273c567-48a2-44b4-9e2d-9d71b1436199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:13.014848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-1273c567-48a2-44b4-9e2d-9d71b1436199 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:13.016051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-1273c567-48a2-44b4-9e2d-9d71b1436199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:13.025381 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 556/1094] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:13.049928 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a012dc-b802-43d5-98fc-9ec0dbeb9336 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:13.069204 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a012dc-b802-43d5-98fc-9ec0dbeb9336 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:13.074595 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437457cc-4684-4eab-a681-ad80727430e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:13.075247 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437457cc-4684-4eab-a681-ad80727430e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:13.075536 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437457cc-4684-4eab-a681-ad80727430e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:13.075816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437457cc-4684-4eab-a681-ad80727430e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:13.077065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437457cc-4684-4eab-a681-ad80727430e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:13.078915 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING py.warnings [None req-437457cc-4684-4eab-a681-ad80727430e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:42:13.078915 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: warnings.warn(msg) Jun 25 20:42:13.078915 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: Jun 25 20:42:13.080076 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437457cc-4684-4eab-a681-ad80727430e8 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:13.098519 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 539/1095] 10.222.0.26 () {56 vars in 1108 bytes} [Sat Jun 25 20:42:13 2022] GET /identity/v3/projects => generated 1606 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:42:15.392736 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ba68-c24c-440e-ac37-e9cd261a1df7 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:15.393332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ba68-c24c-440e-ac37-e9cd261a1df7 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:15.393332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0ba68-c24c-440e-ac37-e9cd261a1df7 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:15.394700 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 557/1096] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:15.401045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec694c-d509-4ab1-9fda-a27405bc2cb0 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:15.401505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec694c-d509-4ab1-9fda-a27405bc2cb0 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:15.401672 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec694c-d509-4ab1-9fda-a27405bc2cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:15.427318 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-59ec694c-d509-4ab1-9fda-a27405bc2cb0 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:15.428518 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-59ec694c-d509-4ab1-9fda-a27405bc2cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:15.436887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 540/1097] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:15.484133 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0ba68-c24c-440e-ac37-e9cd261a1df7 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:15.499943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0ba68-c24c-440e-ac37-e9cd261a1df7 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:15.505782 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8409fb8-d8f1-4b57-bd65-48cc90b7150d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:15.506444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8409fb8-d8f1-4b57-bd65-48cc90b7150d service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:15.506742 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8409fb8-d8f1-4b57-bd65-48cc90b7150d service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:15.507024 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8409fb8-d8f1-4b57-bd65-48cc90b7150d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:15.515565 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8409fb8-d8f1-4b57-bd65-48cc90b7150d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:15.517174 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8409fb8-d8f1-4b57-bd65-48cc90b7150d service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:15.526879 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 558/1098] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:18.041027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df54b-2898-4f83-b83e-ce46f1766846 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:18.041898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df54b-2898-4f83-b83e-ce46f1766846 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:18.041898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df54b-2898-4f83-b83e-ce46f1766846 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:18.044236 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 541/1099] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:42:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:18.050488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6343d-edad-4b74-bae5-11518bd501fe None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:18.051234 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6343d-edad-4b74-bae5-11518bd501fe None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:18.051428 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6343d-edad-4b74-bae5-11518bd501fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:18.074687 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-16c6343d-edad-4b74-bae5-11518bd501fe None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:18.076081 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-16c6343d-edad-4b74-bae5-11518bd501fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:18.086015 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 559/1100] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:18.122940 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9df54b-2898-4f83-b83e-ce46f1766846 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:18.134887 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9df54b-2898-4f83-b83e-ce46f1766846 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:18.139050 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18d055-405e-4bea-a22d-343e192cc59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:18.139691 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18d055-405e-4bea-a22d-343e192cc59b service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:18.139973 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18d055-405e-4bea-a22d-343e192cc59b service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:18.140248 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18d055-405e-4bea-a22d-343e192cc59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:18.150285 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18d055-405e-4bea-a22d-343e192cc59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:18.151843 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb18d055-405e-4bea-a22d-343e192cc59b service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:18.161577 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 542/1101] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:20.502743 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4938-a761-4ad7-8324-0cadcb698d62 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:20.503359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4938-a761-4ad7-8324-0cadcb698d62 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:20.503359 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a4938-a761-4ad7-8324-0cadcb698d62 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:20.504658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 560/1102] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:20.511212 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315ab50-f375-4879-8493-3630e89474df None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:20.512038 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315ab50-f375-4879-8493-3630e89474df None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:20.512194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315ab50-f375-4879-8493-3630e89474df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:20.537121 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-d315ab50-f375-4879-8493-3630e89474df None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:20.538330 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-d315ab50-f375-4879-8493-3630e89474df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:20.547389 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 543/1103] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:20.585753 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a4938-a761-4ad7-8324-0cadcb698d62 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:20.597821 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a4938-a761-4ad7-8324-0cadcb698d62 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:20.602098 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ba695-490b-468c-922d-964c339e8101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:20.602742 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba695-490b-468c-922d-964c339e8101 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:20.603049 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba695-490b-468c-922d-964c339e8101 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:20.603327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ba695-490b-468c-922d-964c339e8101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:20.613280 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ba695-490b-468c-922d-964c339e8101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:20.614794 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ba695-490b-468c-922d-964c339e8101 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:20.625488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 561/1104] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:23.000399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6c7e2-0ae7-4788-bda4-8a12d4e82d7b None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:23.000990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6c7e2-0ae7-4788-bda4-8a12d4e82d7b None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:23.001180 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c6c7e2-0ae7-4788-bda4-8a12d4e82d7b None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:23.002598 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 544/1105] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:23.011574 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b5870-136f-4a1c-b212-2b879a50e003 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:23.012317 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b5870-136f-4a1c-b212-2b879a50e003 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:23.012529 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b5870-136f-4a1c-b212-2b879a50e003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:23.032669 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-875b5870-136f-4a1c-b212-2b879a50e003 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:23.033924 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-875b5870-136f-4a1c-b212-2b879a50e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:23.042606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 562/1106] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:23.087105 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6c7e2-0ae7-4788-bda4-8a12d4e82d7b None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:23.106931 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c6c7e2-0ae7-4788-bda4-8a12d4e82d7b None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:23.111580 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0ac03-a33d-4021-9fef-b971358d39ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:23.112224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0ac03-a33d-4021-9fef-b971358d39ee service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:23.112517 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0ac03-a33d-4021-9fef-b971358d39ee service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:23.112799 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0ac03-a33d-4021-9fef-b971358d39ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:23.122883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0ac03-a33d-4021-9fef-b971358d39ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:23.124521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0ac03-a33d-4021-9fef-b971358d39ee service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:23.134445 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 545/1107] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:25.582972 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b01772-05bf-496c-9c16-abd17d30edd7 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:25.583878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b01772-05bf-496c-9c16-abd17d30edd7 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:25.583878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b01772-05bf-496c-9c16-abd17d30edd7 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:25.586137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 563/1108] 10.222.0.26 () {54 vars in 926 bytes} [Sat Jun 25 20:42:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:42:25.592323 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cabc8-be15-4118-8ba4-51614e62f420 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:25.592800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cabc8-be15-4118-8ba4-51614e62f420 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:25.592896 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cabc8-be15-4118-8ba4-51614e62f420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:25.612816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-283cabc8-be15-4118-8ba4-51614e62f420 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:42:25.614036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-283cabc8-be15-4118-8ba4-51614e62f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:42:25.622552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 546/1109] 10.222.0.26 () {58 vars in 1023 bytes} [Sat Jun 25 20:42:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:42:25.666233 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b01772-05bf-496c-9c16-abd17d30edd7 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:42:25.678783 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b01772-05bf-496c-9c16-abd17d30edd7 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:42:25.682959 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e067d6-cfe2-4e4e-8ae9-5725849299ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:42:25.683599 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e067d6-cfe2-4e4e-8ae9-5725849299ee service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:42:25.683883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e067d6-cfe2-4e4e-8ae9-5725849299ee service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:42:25.684137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e067d6-cfe2-4e4e-8ae9-5725849299ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:42:25.693568 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e067d6-cfe2-4e4e-8ae9-5725849299ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:42:25.695040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e067d6-cfe2-4e4e-8ae9-5725849299ee service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:42:25.704313 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 564/1110] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:42:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:42:35.607342 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=33 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:42:35.700232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=33 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:02.125150 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16ef2-7fb3-4a78-b61c-4f4c59ac3654 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.126057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16ef2-7fb3-4a78-b61c-4f4c59ac3654 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.126057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef16ef2-7fb3-4a78-b61c-4f4c59ac3654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.151912 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-9ef16ef2-7fb3-4a78-b61c-4f4c59ac3654 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:02.153485 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-9ef16ef2-7fb3-4a78-b61c-4f4c59ac3654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:02.167081 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 547/1111] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:44:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:02.175779 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed3694-bcab-4072-88be-0b3f14054c43 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.176317 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed3694-bcab-4072-88be-0b3f14054c43 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.176317 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed3694-bcab-4072-88be-0b3f14054c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.196368 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-18ed3694-bcab-4072-88be-0b3f14054c43 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:02.197507 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-18ed3694-bcab-4072-88be-0b3f14054c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:02.207814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 565/1112] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:44:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:02.212582 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef16ef2-7fb3-4a78-b61c-4f4c59ac3654 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:02.228013 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef16ef2-7fb3-4a78-b61c-4f4c59ac3654 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:02.234659 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:02.235312 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.235594 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.235864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.236590 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:44:02.236914 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:02.237929 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING py.warnings [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:44:02.237929 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: warnings.warn(msg) Jun 25 20:44:02.237929 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: Jun 25 20:44:02.238854 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:02.250837 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 548/1113] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Jun 25 20:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:44:02.258891 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed3694-bcab-4072-88be-0b3f14054c43 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:02.268982 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed3694-bcab-4072-88be-0b3f14054c43 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:02.274985 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f134de-1c21-4021-a47f-953afe723de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:02.275644 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f134de-1c21-4021-a47f-953afe723de7 admin admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.275932 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f134de-1c21-4021-a47f-953afe723de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.276208 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f134de-1c21-4021-a47f-953afe723de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.276910 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f134de-1c21-4021-a47f-953afe723de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:02.279300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: WARNING py.warnings [None req-a9f134de-1c21-4021-a47f-953afe723de7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:44:02.279300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: warnings.warn(msg) Jun 25 20:44:02.279300 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: Jun 25 20:44:02.280528 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f134de-1c21-4021-a47f-953afe723de7 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:02.310411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 566/1114] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Jun 25 20:44:02 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:44:02.314909 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:02.325761 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a76dc79-2fcb-4e68-8d63-c27630a410c6 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:02.384437 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6549552-5a95-4001-9c7d-17011afabeb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:02.385094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6549552-5a95-4001-9c7d-17011afabeb8 admin admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.385384 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6549552-5a95-4001-9c7d-17011afabeb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.385666 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6549552-5a95-4001-9c7d-17011afabeb8 admin admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.386359 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6549552-5a95-4001-9c7d-17011afabeb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:02.387942 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING py.warnings [None req-b6549552-5a95-4001-9c7d-17011afabeb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:44:02.387942 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: warnings.warn(msg) Jun 25 20:44:02.387942 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: Jun 25 20:44:02.389163 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6549552-5a95-4001-9c7d-17011afabeb8 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:02.410726 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 549/1115] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Jun 25 20:44:02 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:44:02.414874 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f134de-1c21-4021-a47f-953afe723de7 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:02.425699 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f134de-1c21-4021-a47f-953afe723de7 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:02.430368 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed234c0-bbdb-44d0-841c-933f29cf118a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:02.431083 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed234c0-bbdb-44d0-841c-933f29cf118a admin admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.431354 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed234c0-bbdb-44d0-841c-933f29cf118a admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.431631 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed234c0-bbdb-44d0-841c-933f29cf118a admin admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.432352 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed234c0-bbdb-44d0-841c-933f29cf118a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:02.433384 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: WARNING py.warnings [None req-6ed234c0-bbdb-44d0-841c-933f29cf118a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:44:02.433384 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: warnings.warn(msg) Jun 25 20:44:02.433384 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: Jun 25 20:44:02.434646 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed234c0-bbdb-44d0-841c-933f29cf118a admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:02.447841 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 567/1116] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:44:02.452051 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6549552-5a95-4001-9c7d-17011afabeb8 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:02.462196 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6549552-5a95-4001-9c7d-17011afabeb8 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:02.467315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c201a-d3ba-4eb9-b70e-730d6b46dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:02.467971 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c201a-d3ba-4eb9-b70e-730d6b46dafc admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.468260 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c201a-d3ba-4eb9-b70e-730d6b46dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.468535 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c201a-d3ba-4eb9-b70e-730d6b46dafc admin admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.469244 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c201a-d3ba-4eb9-b70e-730d6b46dafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:02.470288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING py.warnings [None req-9d8c201a-d3ba-4eb9-b70e-730d6b46dafc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:44:02.470288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: warnings.warn(msg) Jun 25 20:44:02.470288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: Jun 25 20:44:02.471259 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c201a-d3ba-4eb9-b70e-730d6b46dafc admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:02.485149 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 550/1117] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:44:02.490184 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed234c0-bbdb-44d0-841c-933f29cf118a admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:02.502694 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed234c0-bbdb-44d0-841c-933f29cf118a admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:02.508137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830919d-e1ae-4e2b-bd36-7e09e4719341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:02.509022 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830919d-e1ae-4e2b-bd36-7e09e4719341 admin admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.509306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830919d-e1ae-4e2b-bd36-7e09e4719341 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.509582 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830919d-e1ae-4e2b-bd36-7e09e4719341 admin admin] PATH_INFO: `/v3/projects/13746a71996c497e83e16c24df8adb2a/users/97de8b4d05b94948aa3c181105cd3cce/roles/209cb6e49795432bb796352cec30474f` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.525757 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830919d-e1ae-4e2b-bd36-7e09e4719341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13746a71996c497e83e16c24df8adb2a, user_id=97de8b4d05b94948aa3c181105cd3cce, role_id=209cb6e49795432bb796352cec30474f)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:02.526853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: WARNING py.warnings [None req-e830919d-e1ae-4e2b-bd36-7e09e4719341 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:44:02.526853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: warnings.warn(msg) Jun 25 20:44:02.526853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: Jun 25 20:44:02.528915 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830919d-e1ae-4e2b-bd36-7e09e4719341 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:02.544513 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 568/1118] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Jun 25 20:44:02 2022] PUT /identity/v3/projects/13746a71996c497e83e16c24df8adb2a/users/97de8b4d05b94948aa3c181105cd3cce/roles/209cb6e49795432bb796352cec30474f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:44:02.555874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b089bc-5fd8-4570-9756-e78a34d2cc9e None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.556191 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b089bc-5fd8-4570-9756-e78a34d2cc9e None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.556470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b089bc-5fd8-4570-9756-e78a34d2cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.584515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-41b089bc-5fd8-4570-9756-e78a34d2cc9e None None] MFA Rules not processed for user `97de8b4d05b94948aa3c181105cd3cce`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:02.585766 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-41b089bc-5fd8-4570-9756-e78a34d2cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:02.652826 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 551/1119] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:44:02 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:44:02.667395 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796c38-374b-4852-b8a4-bce130e76e60 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.667752 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796c38-374b-4852-b8a4-bce130e76e60 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.668229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9796c38-374b-4852-b8a4-bce130e76e60 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.669590 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 569/1120] 10.222.0.26 () {54 vars in 963 bytes} [Sat Jun 25 20:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:02.674483 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e32e-b674-4be0-9352-8e0aa955a24f None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.674819 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e32e-b674-4be0-9352-8e0aa955a24f None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.675091 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37e32e-b674-4be0-9352-8e0aa955a24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.693253 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-8f37e32e-b674-4be0-9352-8e0aa955a24f None None] MFA Rules not processed for user `fc0920a9a54d4d839f1e2125431e9d19`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:02.694528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-8f37e32e-b674-4be0-9352-8e0aa955a24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:02.740254 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:02.749883 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 552/1121] 10.222.0.26 () {58 vars in 1060 bytes} [Sat Jun 25 20:44:02 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:44:02.764588 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9796c38-374b-4852-b8a4-bce130e76e60 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:02.776501 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9796c38-374b-4852-b8a4-bce130e76e60 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:02.780853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da01ac5-677d-4553-a766-fddb1693bbf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0920a9a54d4d839f1e2125431e9d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:02.781496 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da01ac5-677d-4553-a766-fddb1693bbf6 service cinder] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.781783 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da01ac5-677d-4553-a766-fddb1693bbf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.782063 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da01ac5-677d-4553-a766-fddb1693bbf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.791089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da01ac5-677d-4553-a766-fddb1693bbf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:02.792667 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da01ac5-677d-4553-a766-fddb1693bbf6 service cinder] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:02.802391 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 570/1122] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:44:02 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:44:02.838783 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17fb1-69c2-4498-9356-112d3692549a None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.839144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17fb1-69c2-4498-9356-112d3692549a None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.839474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a17fb1-69c2-4498-9356-112d3692549a None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.841018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 553/1123] 10.222.0.26 () {52 vars in 829 bytes} [Sat Jun 25 20:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:44:02.844904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da01ac5-677d-4553-a766-fddb1693bbf6 service cinder] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:02.920778 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da01ac5-677d-4553-a766-fddb1693bbf6 service cinder] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:02.926108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:02.927036 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:02.927328 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:02.927643 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] PATH_INFO: `/v3/users/97de8b4d05b94948aa3c181105cd3cce` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:02.928913 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97de8b4d05b94948aa3c181105cd3cce)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:02.929967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: WARNING py.warnings [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:44:02.929967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: warnings.warn(msg) Jun 25 20:44:02.929967 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: Jun 25 20:44:02.931253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:03.000120 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97de8b4d05b94948aa3c181105cd3cce'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.019593 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97de8b4d05b94948aa3c181105cd3cce'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.020363 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97de8b4d05b94948aa3c181105cd3cce'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.029912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97de8b4d05b94948aa3c181105cd3cce'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.030705 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97de8b4d05b94948aa3c181105cd3cce'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.048718 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 571/1124] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Jun 25 20:44:02 2022] DELETE /identity/v3/users/97de8b4d05b94948aa3c181105cd3cce => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:44:03.053332 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196372-b013-486a-b393-5362566c7b82 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:03.053624 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196372-b013-486a-b393-5362566c7b82 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:03.053902 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196372-b013-486a-b393-5362566c7b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:03.072513 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-b1196372-b013-486a-b393-5362566c7b82 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:44:03.073724 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-b1196372-b013-486a-b393-5362566c7b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:03.142085 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 554/1125] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:44:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:44:03.152973 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:03.154409 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:03.160247 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:03.217126 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be69a5a-a6eb-4b6d-b96b-142ff43935c1 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:03.221059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab45b6-0e31-4585-ac91-fd0d92ac77cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:03.221711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab45b6-0e31-4585-ac91-fd0d92ac77cf service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:03.221989 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab45b6-0e31-4585-ac91-fd0d92ac77cf service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:03.222272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab45b6-0e31-4585-ac91-fd0d92ac77cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:03.232264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab45b6-0e31-4585-ac91-fd0d92ac77cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:03.233710 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab45b6-0e31-4585-ac91-fd0d92ac77cf service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:03.243592 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 572/1126] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:44:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:44:03.584914 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196372-b013-486a-b393-5362566c7b82 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:44:03.586601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-b1196372-b013-486a-b393-5362566c7b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:44:03.599535 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196372-b013-486a-b393-5362566c7b82 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:44:03.605539 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:44:03.606470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:44:03.606759 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:44:03.607036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] PATH_INFO: `/v3/projects/13746a71996c497e83e16c24df8adb2a` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:44:03.609484 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13746a71996c497e83e16c24df8adb2a)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:44:03.610557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING py.warnings [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:44:03.610557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: warnings.warn(msg) Jun 25 20:44:03.610557 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: Jun 25 20:44:03.611782 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:44:03.682950 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13746a71996c497e83e16c24df8adb2a', 'request_id': 'req-52af9269-4576-447f-ae3c-4dabccf82674'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.690036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13746a71996c497e83e16c24df8adb2a', 'request_id': 'req-52af9269-4576-447f-ae3c-4dabccf82674'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.702925 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13746a71996c497e83e16c24df8adb2a', 'request_id': 'req-52af9269-4576-447f-ae3c-4dabccf82674'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.721442 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] The token cache is being invalidate because project 13746a71996c497e83e16c24df8adb2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:44:03.721750 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.722386 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-52af9269-4576-447f-ae3c-4dabccf82674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:44:03.724102 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 555/1127] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Jun 25 20:44:03 2022] DELETE /identity/v3/projects/13746a71996c497e83e16c24df8adb2a => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:44:13.239126 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=25 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:44:13.718224 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:45:23.431904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796ba7a-d4e8-41f3-a056-84e111fc39fc None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:23.432856 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796ba7a-d4e8-41f3-a056-84e111fc39fc None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:23.432856 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796ba7a-d4e8-41f3-a056-84e111fc39fc None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:23.435131 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 573/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:45:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:45:23.441214 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b31bc-6855-401c-9fa6-53a030df8fda None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:23.441939 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b31bc-6855-401c-9fa6-53a030df8fda None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:23.442042 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b31bc-6855-401c-9fa6-53a030df8fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:23.521034 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-3e2b31bc-6855-401c-9fa6-53a030df8fda None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:23.522265 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-3e2b31bc-6855-401c-9fa6-53a030df8fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:23.621329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 556/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:45:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:23.784976 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796ba7a-d4e8-41f3-a056-84e111fc39fc None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:23.787976 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-b796ba7a-d4e8-41f3-a056-84e111fc39fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:23.889764 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796ba7a-d4e8-41f3-a056-84e111fc39fc None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:45:23.896101 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92119943-2a2b-48e1-9ee2-8c233cee8ae0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:45:23.896751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119943-2a2b-48e1-9ee2-8c233cee8ae0 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:23.897041 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119943-2a2b-48e1-9ee2-8c233cee8ae0 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:23.897321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92119943-2a2b-48e1-9ee2-8c233cee8ae0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:23.905919 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119943-2a2b-48e1-9ee2-8c233cee8ae0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:45:23.907576 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92119943-2a2b-48e1-9ee2-8c233cee8ae0 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:45:23.917370 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 574/1130] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:45:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:45:24.753505 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da29f14-216f-4c23-9147-4d0d14d61664 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:24.754108 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da29f14-216f-4c23-9147-4d0d14d61664 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:24.754108 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da29f14-216f-4c23-9147-4d0d14d61664 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:24.755497 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 557/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:45:24.761584 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7648-571b-4f02-bb33-b342d9190ac2 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:24.762340 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7648-571b-4f02-bb33-b342d9190ac2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:24.762472 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7648-571b-4f02-bb33-b342d9190ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:24.787945 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-55da7648-571b-4f02-bb33-b342d9190ac2 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:24.789183 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-55da7648-571b-4f02-bb33-b342d9190ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:24.798189 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 575/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:45:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:24.961370 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da29f14-216f-4c23-9147-4d0d14d61664 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:24.977126 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da29f14-216f-4c23-9147-4d0d14d61664 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:45:24.983312 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e571be36-85b5-47c9-968a-04da1d10ae7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:45:24.983957 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571be36-85b5-47c9-968a-04da1d10ae7d service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:24.984246 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571be36-85b5-47c9-968a-04da1d10ae7d service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:24.984511 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e571be36-85b5-47c9-968a-04da1d10ae7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:24.993357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571be36-85b5-47c9-968a-04da1d10ae7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:45:24.994986 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e571be36-85b5-47c9-968a-04da1d10ae7d service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:45:25.005132 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 558/1133] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:45:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:45:29.723110 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769821c-81be-4509-83c3-7fb776c91fd9 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:29.723697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769821c-81be-4509-83c3-7fb776c91fd9 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:29.723697 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769821c-81be-4509-83c3-7fb776c91fd9 None None] PATH_INFO: `/v3` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:29.725339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 576/1134] 10.222.0.18 () {54 vars in 925 bytes} [Sat Jun 25 20:45:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:45:29.732467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a9882-aa59-406b-98e4-3a7bcff9c63f None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:29.732945 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a9882-aa59-406b-98e4-3a7bcff9c63f None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:29.733048 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a9882-aa59-406b-98e4-3a7bcff9c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:29.763346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-ff6a9882-aa59-406b-98e4-3a7bcff9c63f None None] MFA Rules not processed for user `d91c64b1ed4e49c7870ac00844b29bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:29.764552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-ff6a9882-aa59-406b-98e4-3a7bcff9c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:29.826192 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:45:29.836578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 559/1135] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Jun 25 20:45:29 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:34.113994 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a6252-6109-4f58-8788-a247fa81f1c2 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:34.114968 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a6252-6109-4f58-8788-a247fa81f1c2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:34.114968 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a6252-6109-4f58-8788-a247fa81f1c2 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:34.117115 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 577/1136] 10.222.0.26 () {54 vars in 960 bytes} [Sat Jun 25 20:45:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:45:34.124679 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9462a1-ab58-41be-894e-dea60571b2ae None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:34.125107 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9462a1-ab58-41be-894e-dea60571b2ae None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:34.125198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9462a1-ab58-41be-894e-dea60571b2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:34.144889 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-3f9462a1-ab58-41be-894e-dea60571b2ae None None] MFA Rules not processed for user `d91c64b1ed4e49c7870ac00844b29bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:34.146110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-3f9462a1-ab58-41be-894e-dea60571b2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:34.155304 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 560/1137] 10.222.0.26 () {58 vars in 1057 bytes} [Sat Jun 25 20:45:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:45:34.162725 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a6252-6109-4f58-8788-a247fa81f1c2 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:34.177901 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a6252-6109-4f58-8788-a247fa81f1c2 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:45:34.184256 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f5f34-2a78-4d42-b63f-caf077c7f988 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91c64b1ed4e49c7870ac00844b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:45:34.184825 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5f34-2a78-4d42-b63f-caf077c7f988 service placement] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:34.185109 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5f34-2a78-4d42-b63f-caf077c7f988 service placement] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:34.185397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f5f34-2a78-4d42-b63f-caf077c7f988 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:34.194344 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f5f34-2a78-4d42-b63f-caf077c7f988 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:45:34.196005 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f5f34-2a78-4d42-b63f-caf077c7f988 service placement] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:45:34.205918 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 578/1138] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:45:34 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:45:36.261326 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c72787-8480-4a40-9bec-a5495687c04a None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:36.261965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c72787-8480-4a40-9bec-a5495687c04a None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:36.261965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c72787-8480-4a40-9bec-a5495687c04a None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:36.263315 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 561/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:45:36.269321 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e357390-12b1-47f2-a2ad-e1e4e74bd1e0 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:36.270030 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e357390-12b1-47f2-a2ad-e1e4e74bd1e0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:36.270188 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e357390-12b1-47f2-a2ad-e1e4e74bd1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:36.290853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-1e357390-12b1-47f2-a2ad-e1e4e74bd1e0 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:36.292065 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-1e357390-12b1-47f2-a2ad-e1e4e74bd1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:36.300494 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 579/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:45:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:36.459336 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c72787-8480-4a40-9bec-a5495687c04a None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:36.474225 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c72787-8480-4a40-9bec-a5495687c04a None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:45:36.480588 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f814f-8459-427f-a18d-87b5fcbe393c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:45:36.481226 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f814f-8459-427f-a18d-87b5fcbe393c service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:36.481512 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f814f-8459-427f-a18d-87b5fcbe393c service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:36.481792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f814f-8459-427f-a18d-87b5fcbe393c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:36.490343 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f814f-8459-427f-a18d-87b5fcbe393c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:45:36.491976 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f814f-8459-427f-a18d-87b5fcbe393c service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:45:36.501311 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 562/1141] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:45:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:45:37.323625 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcbe7d-835b-444a-af9c-71b64d5ff39e None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:37.324226 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcbe7d-835b-444a-af9c-71b64d5ff39e None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:37.324226 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcbe7d-835b-444a-af9c-71b64d5ff39e None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:37.325545 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 580/1142] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 25 20:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:45:37.331661 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc9b55-e67c-465a-82de-e162d9377933 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:37.332539 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc9b55-e67c-465a-82de-e162d9377933 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:37.332702 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc9b55-e67c-465a-82de-e162d9377933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:37.353920 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-ebbc9b55-e67c-465a-82de-e162d9377933 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:37.355123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-ebbc9b55-e67c-465a-82de-e162d9377933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:37.364055 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 563/1143] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 25 20:45:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:37.523272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcbe7d-835b-444a-af9c-71b64d5ff39e None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:37.541946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcbe7d-835b-444a-af9c-71b64d5ff39e None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:45:37.548416 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3077e7d-c5aa-4324-b47b-3a524f75b708 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:45:37.549066 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3077e7d-c5aa-4324-b47b-3a524f75b708 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:37.549357 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3077e7d-c5aa-4324-b47b-3a524f75b708 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:37.549645 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3077e7d-c5aa-4324-b47b-3a524f75b708 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:37.558339 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3077e7d-c5aa-4324-b47b-3a524f75b708 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:45:37.559998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3077e7d-c5aa-4324-b47b-3a524f75b708 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:45:37.570452 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 581/1144] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:45:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:45:41.675455 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b17852-d8f8-4d05-a822-512026a1a2a7 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:41.676086 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b17852-d8f8-4d05-a822-512026a1a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:41.676086 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b17852-d8f8-4d05-a822-512026a1a2a7 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:41.677399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 564/1145] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:45:41.685628 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733ff6f-dd98-4403-aa59-01e91f5ea979 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:41.686324 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733ff6f-dd98-4403-aa59-01e91f5ea979 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:41.687281 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733ff6f-dd98-4403-aa59-01e91f5ea979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:41.712389 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-9733ff6f-dd98-4403-aa59-01e91f5ea979 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:41.713608 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-9733ff6f-dd98-4403-aa59-01e91f5ea979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:41.723268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 582/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:45:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:41.762895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b17852-d8f8-4d05-a822-512026a1a2a7 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:41.765576 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-e9b17852-d8f8-4d05-a822-512026a1a2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:41.832172 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b17852-d8f8-4d05-a822-512026a1a2a7 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:45:41.838874 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b444c14-eef7-4d18-8114-0d6949ce9806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:45:41.839617 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b444c14-eef7-4d18-8114-0d6949ce9806 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:41.839994 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b444c14-eef7-4d18-8114-0d6949ce9806 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:41.840346 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b444c14-eef7-4d18-8114-0d6949ce9806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:41.856110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b444c14-eef7-4d18-8114-0d6949ce9806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:45:41.858233 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b444c14-eef7-4d18-8114-0d6949ce9806 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:45:41.868164 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 565/1147] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:45:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:45:44.104607 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055956-6a52-435f-993b-a53367789b38 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:44.105485 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055956-6a52-435f-993b-a53367789b38 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:44.105485 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b055956-6a52-435f-993b-a53367789b38 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:44.107995 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 583/1148] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:45:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:45:44.113028 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40295339-2c5c-4805-8fbc-55a0429b7780 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:44.113459 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40295339-2c5c-4805-8fbc-55a0429b7780 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:44.113550 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40295339-2c5c-4805-8fbc-55a0429b7780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:44.132350 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-40295339-2c5c-4805-8fbc-55a0429b7780 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:44.133554 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-40295339-2c5c-4805-8fbc-55a0429b7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:44.142070 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 566/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:45:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:44.184564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b055956-6a52-435f-993b-a53367789b38 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:44.187240 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-7b055956-6a52-435f-993b-a53367789b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:44.201878 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b055956-6a52-435f-993b-a53367789b38 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:45:44.205951 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53e5e9-4d39-419e-b058-2ad1d9f06641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:45:44.206624 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e5e9-4d39-419e-b058-2ad1d9f06641 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:44.206914 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e5e9-4d39-419e-b058-2ad1d9f06641 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:44.207186 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53e5e9-4d39-419e-b058-2ad1d9f06641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:44.217308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53e5e9-4d39-419e-b058-2ad1d9f06641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:45:44.218785 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53e5e9-4d39-419e-b058-2ad1d9f06641 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:45:44.228857 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 584/1150] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:45:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:45:48.022229 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c760-25b7-4bb9-bf43-34a274b83dd5 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:48.023145 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c760-25b7-4bb9-bf43-34a274b83dd5 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:48.023145 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54c760-25b7-4bb9-bf43-34a274b83dd5 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:48.025533 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 567/1151] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:45:48.030606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c77160-9c14-4ccb-a8e4-dc979621e03b None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:48.031092 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c77160-9c14-4ccb-a8e4-dc979621e03b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:48.031191 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c77160-9c14-4ccb-a8e4-dc979621e03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:48.049411 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-f3c77160-9c14-4ccb-a8e4-dc979621e03b None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:48.050641 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-f3c77160-9c14-4ccb-a8e4-dc979621e03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:48.059497 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 585/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:45:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:45:48.331456 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54c760-25b7-4bb9-bf43-34a274b83dd5 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:48.334021 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-ab54c760-25b7-4bb9-bf43-34a274b83dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:48.398113 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54c760-25b7-4bb9-bf43-34a274b83dd5 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:45:48.402255 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6da3b1-6b6d-4723-bfd9-8bc4bee3fa19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0920a9a54d4d839f1e2125431e9d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:45:48.402924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da3b1-6b6d-4723-bfd9-8bc4bee3fa19 service cinder] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:48.403206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da3b1-6b6d-4723-bfd9-8bc4bee3fa19 service cinder] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:48.403481 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da3b1-6b6d-4723-bfd9-8bc4bee3fa19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:48.413243 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6da3b1-6b6d-4723-bfd9-8bc4bee3fa19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:45:48.414714 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6da3b1-6b6d-4723-bfd9-8bc4bee3fa19 service cinder] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:45:48.424490 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 568/1153] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:45:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:45:50.715356 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acdf84-ae4c-410a-935b-0d97b53931d6 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:50.715966 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acdf84-ae4c-410a-935b-0d97b53931d6 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:50.715966 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acdf84-ae4c-410a-935b-0d97b53931d6 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:50.717541 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 586/1154] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 25 20:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:45:50.723877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f3af4-81d7-49bd-936b-cb2d3fffc3b1 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:50.724950 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f3af4-81d7-49bd-936b-cb2d3fffc3b1 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:50.725121 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f3af4-81d7-49bd-936b-cb2d3fffc3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:50.748673 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-a17f3af4-81d7-49bd-936b-cb2d3fffc3b1 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:45:50.749882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-a17f3af4-81d7-49bd-936b-cb2d3fffc3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:50.761842 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 569/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 25 20:45:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:45:51.034455 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acdf84-ae4c-410a-935b-0d97b53931d6 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:45:51.036532 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-39acdf84-ae4c-410a-935b-0d97b53931d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:45:51.052140 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acdf84-ae4c-410a-935b-0d97b53931d6 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:45:51.056557 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7592750-34c2-4b37-8a8c-9d2d840c13a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc0920a9a54d4d839f1e2125431e9d19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:45:51.057195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7592750-34c2-4b37-8a8c-9d2d840c13a8 service cinder] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:45:51.057482 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7592750-34c2-4b37-8a8c-9d2d840c13a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:45:51.057751 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7592750-34c2-4b37-8a8c-9d2d840c13a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:45:51.067440 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7592750-34c2-4b37-8a8c-9d2d840c13a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:45:51.068872 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7592750-34c2-4b37-8a8c-9d2d840c13a8 service cinder] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:45:51.078308 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 587/1156] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:45:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:46:00.742472 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=70 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:46:01.074512 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=75 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:09.360799 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fa523-a688-4630-8f48-acdbe60ca891 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.361487 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fa523-a688-4630-8f48-acdbe60ca891 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.361487 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1fa523-a688-4630-8f48-acdbe60ca891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.379050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253045a-ca6d-48db-9264-b52f67978a1c None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.379684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253045a-ca6d-48db-9264-b52f67978a1c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.379684 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253045a-ca6d-48db-9264-b52f67978a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.389073 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-6e1fa523-a688-4630-8f48-acdbe60ca891 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:09.399894 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-1253045a-ca6d-48db-9264-b52f67978a1c None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:09.400117 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-6e1fa523-a688-4630-8f48-acdbe60ca891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:09.401089 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-1253045a-ca6d-48db-9264-b52f67978a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:09.408276 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 570/1157] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:09.409538 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 588/1158] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:47:09.417367 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778718-149e-4967-b9a8-0e4e35a5f157 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.417661 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778718-149e-4967-b9a8-0e4e35a5f157 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.417903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c64fca-50f1-4b53-94c2-fde086687ef8 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.418012 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778718-149e-4967-b9a8-0e4e35a5f157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.418200 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c64fca-50f1-4b53-94c2-fde086687ef8 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.418523 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c64fca-50f1-4b53-94c2-fde086687ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.437305 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-f7c64fca-50f1-4b53-94c2-fde086687ef8 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:09.437562 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-b6778718-149e-4967-b9a8-0e4e35a5f157 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:09.438565 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-f7c64fca-50f1-4b53-94c2-fde086687ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:09.438689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-b6778718-149e-4967-b9a8-0e4e35a5f157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:09.446783 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 589/1159] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:09.450712 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 571/1160] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:09.451516 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c64fca-50f1-4b53-94c2-fde086687ef8 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.452357 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6778718-149e-4967-b9a8-0e4e35a5f157 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.460997 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c64fca-50f1-4b53-94c2-fde086687ef8 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.461947 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6778718-149e-4967-b9a8-0e4e35a5f157 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.466899 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.467565 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.467852 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.468016 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57de15-a40e-47b3-9302-5e2be8130d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.468128 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] PATH_INFO: `/v3/domains` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.468546 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57de15-a40e-47b3-9302-5e2be8130d03 admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.468847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93695) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:47:09.468996 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57de15-a40e-47b3-9302-5e2be8130d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.469134 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.469261 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57de15-a40e-47b3-9302-5e2be8130d03 admin admin] PATH_INFO: `/v3/domains` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.469898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57de15-a40e-47b3-9302-5e2be8130d03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93694) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 25 20:47:09.470193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: WARNING py.warnings [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:47:09.470193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: warnings.warn(msg) Jun 25 20:47:09.470193 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: Jun 25 20:47:09.470549 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57de15-a40e-47b3-9302-5e2be8130d03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.471141 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.471925 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f57de15-a40e-47b3-9302-5e2be8130d03 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.483959 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 590/1161] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Jun 25 20:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 25 20:47:09.484347 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 572/1162] 10.222.0.26 () {58 vars in 1152 bytes} [Sat Jun 25 20:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 25 20:47:09.493223 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.493424 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57de15-a40e-47b3-9302-5e2be8130d03 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.503649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace455fb-6f25-44be-b2f6-f15e61e5657d admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.503849 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f57de15-a40e-47b3-9302-5e2be8130d03 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.508278 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ee59a-b107-4ef7-a843-a88c3b548dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.508442 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe97cfb-9aa5-4d27-a25c-dcb334d809a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.508946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ee59a-b107-4ef7-a843-a88c3b548dbf admin admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.509068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe97cfb-9aa5-4d27-a25c-dcb334d809a8 admin admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.509229 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ee59a-b107-4ef7-a843-a88c3b548dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.509333 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe97cfb-9aa5-4d27-a25c-dcb334d809a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.509509 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ee59a-b107-4ef7-a843-a88c3b548dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.509627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe97cfb-9aa5-4d27-a25c-dcb334d809a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.510214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ee59a-b107-4ef7-a843-a88c3b548dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.510329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe97cfb-9aa5-4d27-a25c-dcb334d809a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.511324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING py.warnings [None req-dfe97cfb-9aa5-4d27-a25c-dcb334d809a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:47:09.511324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: warnings.warn(msg) Jun 25 20:47:09.511324 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: Jun 25 20:47:09.512232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ee59a-b107-4ef7-a843-a88c3b548dbf admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.512552 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe97cfb-9aa5-4d27-a25c-dcb334d809a8 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.551796 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 573/1163] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:47:09.554155 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 591/1164] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:47:09.556286 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe97cfb-9aa5-4d27-a25c-dcb334d809a8 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.558278 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ee59a-b107-4ef7-a843-a88c3b548dbf admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.623924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe97cfb-9aa5-4d27-a25c-dcb334d809a8 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.629912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ee59a-b107-4ef7-a843-a88c3b548dbf admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.631809 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f5aea-4fac-40ec-8d84-610e42516514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.632498 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f5aea-4fac-40ec-8d84-610e42516514 admin admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.632792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f5aea-4fac-40ec-8d84-610e42516514 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.633694 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f5aea-4fac-40ec-8d84-610e42516514 admin admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.634542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f5aea-4fac-40ec-8d84-610e42516514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.635000 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e056443-3c59-4a96-a036-4b25ca1cd0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.635689 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e056443-3c59-4a96-a036-4b25ca1cd0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.635975 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e056443-3c59-4a96-a036-4b25ca1cd0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.636255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e056443-3c59-4a96-a036-4b25ca1cd0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.636591 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f5aea-4fac-40ec-8d84-610e42516514 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.636969 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e056443-3c59-4a96-a036-4b25ca1cd0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.638010 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: WARNING py.warnings [None req-4e056443-3c59-4a96-a036-4b25ca1cd0c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:47:09.638010 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: warnings.warn(msg) Jun 25 20:47:09.638010 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: Jun 25 20:47:09.639499 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e056443-3c59-4a96-a036-4b25ca1cd0c2 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.665963 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 574/1165] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:47:09.667431 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 592/1166] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:47:09.669360 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f5aea-4fac-40ec-8d84-610e42516514 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.671886 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e056443-3c59-4a96-a036-4b25ca1cd0c2 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.681837 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f5aea-4fac-40ec-8d84-610e42516514 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.685102 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e056443-3c59-4a96-a036-4b25ca1cd0c2 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.688052 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25e0b-298b-4c95-bcfb-5010977e3b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.688845 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25e0b-298b-4c95-bcfb-5010977e3b8c admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.689157 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25e0b-298b-4c95-bcfb-5010977e3b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.689379 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d25e0b-298b-4c95-bcfb-5010977e3b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.690109 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d25e0b-298b-4c95-bcfb-5010977e3b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.691456 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd305b-a91a-412b-9c14-8c94735f3d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.691864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d25e0b-298b-4c95-bcfb-5010977e3b8c admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.692228 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd305b-a91a-412b-9c14-8c94735f3d78 admin admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.692520 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd305b-a91a-412b-9c14-8c94735f3d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.692830 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd305b-a91a-412b-9c14-8c94735f3d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.693611 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd305b-a91a-412b-9c14-8c94735f3d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.695519 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd305b-a91a-412b-9c14-8c94735f3d78 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.703617 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 575/1167] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:47:09.707272 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 593/1168] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:47:09.707823 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25e0b-298b-4c95-bcfb-5010977e3b8c admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.711460 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd305b-a91a-412b-9c14-8c94735f3d78 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.719036 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d25e0b-298b-4c95-bcfb-5010977e3b8c admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.721943 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd305b-a91a-412b-9c14-8c94735f3d78 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.724795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ba90b-94e5-4033-9107-9fd9f3558d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.725477 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ba90b-94e5-4033-9107-9fd9f3558d56 admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.725766 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ba90b-94e5-4033-9107-9fd9f3558d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.726045 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ba90b-94e5-4033-9107-9fd9f3558d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.726816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ba90b-94e5-4033-9107-9fd9f3558d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.726965 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f0af1-c4aa-4ff4-afd3-ad3fc2734940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.727795 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f0af1-c4aa-4ff4-afd3-ad3fc2734940 admin admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.728261 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f0af1-c4aa-4ff4-afd3-ad3fc2734940 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.728581 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ba90b-94e5-4033-9107-9fd9f3558d56 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.728762 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f0af1-c4aa-4ff4-afd3-ad3fc2734940 admin admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.730104 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f0af1-c4aa-4ff4-afd3-ad3fc2734940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.732966 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f0af1-c4aa-4ff4-afd3-ad3fc2734940 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.740255 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 576/1169] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:47:09.746696 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ba90b-94e5-4033-9107-9fd9f3558d56 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.746855 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 594/1170] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:47:09.749132 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f0af1-c4aa-4ff4-afd3-ad3fc2734940 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.756676 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ba90b-94e5-4033-9107-9fd9f3558d56 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.759911 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f0af1-c4aa-4ff4-afd3-ad3fc2734940 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.762071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc24a4e-b091-49f9-ad12-4d30c8b0295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.763395 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc24a4e-b091-49f9-ad12-4d30c8b0295d admin admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.763671 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc24a4e-b091-49f9-ad12-4d30c8b0295d admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.763949 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc24a4e-b091-49f9-ad12-4d30c8b0295d admin admin] PATH_INFO: `/v3/projects/f78e759b32fe4fd6b4cd42757069824f/users/39b53390061840f4bc577c5f507fabc1/roles/209cb6e49795432bb796352cec30474f` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.764518 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1c033-6c79-441f-b4bf-6e7a5a08f482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.765416 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c033-6c79-441f-b4bf-6e7a5a08f482 admin admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.765705 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c033-6c79-441f-b4bf-6e7a5a08f482 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.765989 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c033-6c79-441f-b4bf-6e7a5a08f482 admin admin] PATH_INFO: `/v3/projects/244599ab2d6848fcaf4fda46b932554d/users/490615605dbf4c4cb609d401ce2e8505/roles/209cb6e49795432bb796352cec30474f` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.780917 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc24a4e-b091-49f9-ad12-4d30c8b0295d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78e759b32fe4fd6b4cd42757069824f, user_id=39b53390061840f4bc577c5f507fabc1, role_id=209cb6e49795432bb796352cec30474f)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.781622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c033-6c79-441f-b4bf-6e7a5a08f482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=244599ab2d6848fcaf4fda46b932554d, user_id=490615605dbf4c4cb609d401ce2e8505, role_id=209cb6e49795432bb796352cec30474f)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.782071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING py.warnings [None req-0bc24a4e-b091-49f9-ad12-4d30c8b0295d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:47:09.782071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: warnings.warn(msg) Jun 25 20:47:09.782071 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: Jun 25 20:47:09.784128 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc24a4e-b091-49f9-ad12-4d30c8b0295d admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.785216 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1c033-6c79-441f-b4bf-6e7a5a08f482 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.801891 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 577/1171] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Jun 25 20:47:09 2022] PUT /identity/v3/projects/f78e759b32fe4fd6b4cd42757069824f/users/39b53390061840f4bc577c5f507fabc1/roles/209cb6e49795432bb796352cec30474f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:47:09.802635 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 595/1172] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Jun 25 20:47:09 2022] PUT /identity/v3/projects/244599ab2d6848fcaf4fda46b932554d/users/490615605dbf4c4cb609d401ce2e8505/roles/209cb6e49795432bb796352cec30474f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:47:09.808061 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a876de-5fb2-4969-8582-2bf39cc76b58 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.808352 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a876de-5fb2-4969-8582-2bf39cc76b58 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.808468 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a761-e759-46c8-8737-f4a63f9ddbdc None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.808690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a876de-5fb2-4969-8582-2bf39cc76b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.808816 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a761-e759-46c8-8737-f4a63f9ddbdc None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.808980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7a761-e759-46c8-8737-f4a63f9ddbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.826946 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-b8c7a761-e759-46c8-8737-f4a63f9ddbdc None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:09.827182 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-e7a876de-5fb2-4969-8582-2bf39cc76b58 None None] MFA Rules not processed for user `5c76b07e47a84c48b4608f75eeee3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:09.828195 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-b8c7a761-e759-46c8-8737-f4a63f9ddbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:09.828374 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-e7a876de-5fb2-4969-8582-2bf39cc76b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:09.871227 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:09.871902 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:09.891696 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 578/1173] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:09.892721 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 596/1174] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:47:09.902437 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a876de-5fb2-4969-8582-2bf39cc76b58 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.903544 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7a761-e759-46c8-8737-f4a63f9ddbdc None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:09.962408 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a876de-5fb2-4969-8582-2bf39cc76b58 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:09.966738 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10144a9c-e187-4aaf-8d06-25b283e78580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:09.967383 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10144a9c-e187-4aaf-8d06-25b283e78580 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:09.967669 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10144a9c-e187-4aaf-8d06-25b283e78580 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:09.967950 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10144a9c-e187-4aaf-8d06-25b283e78580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:09.978094 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10144a9c-e187-4aaf-8d06-25b283e78580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:09.979603 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10144a9c-e187-4aaf-8d06-25b283e78580 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:09.992622 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 579/1175] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:47:09.997483 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7a761-e759-46c8-8737-f4a63f9ddbdc None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:10.002596 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812551d5-6f49-4127-a3f8-9cddd6fc802e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:10.003259 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812551d5-6f49-4127-a3f8-9cddd6fc802e service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:10.003542 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812551d5-6f49-4127-a3f8-9cddd6fc802e service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:10.003780 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812551d5-6f49-4127-a3f8-9cddd6fc802e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:10.014510 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812551d5-6f49-4127-a3f8-9cddd6fc802e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:10.015995 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812551d5-6f49-4127-a3f8-9cddd6fc802e service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:10.028253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 597/1176] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:47:15.796785 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b72e2d-0728-4abb-acae-249e64b7edca None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:15.797421 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b72e2d-0728-4abb-acae-249e64b7edca None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:15.797681 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b72e2d-0728-4abb-acae-249e64b7edca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:15.852607 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-32b72e2d-0728-4abb-acae-249e64b7edca None None] MFA Rules not processed for user `490615605dbf4c4cb609d401ce2e8505`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:15.853474 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-32b72e2d-0728-4abb-acae-249e64b7edca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:15.968711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bafa7-ae70-4c79-a1d0-6bf00c9017d6 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:15.969519 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bafa7-ae70-4c79-a1d0-6bf00c9017d6 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:15.969821 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0bafa7-ae70-4c79-a1d0-6bf00c9017d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:15.997330 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 580/1177] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:15 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:16.002132 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b72e2d-0728-4abb-acae-249e64b7edca None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.017131 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b72e2d-0728-4abb-acae-249e64b7edca None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.022778 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-4a0bafa7-ae70-4c79-a1d0-6bf00c9017d6 None None] MFA Rules not processed for user `39b53390061840f4bc577c5f507fabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:16.023792 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c501d3-fe05-42ef-ac86-0e0b76f78667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.024429 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-4a0bafa7-ae70-4c79-a1d0-6bf00c9017d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:16.024601 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c501d3-fe05-42ef-ac86-0e0b76f78667 admin admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.024955 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c501d3-fe05-42ef-ac86-0e0b76f78667 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.025294 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c501d3-fe05-42ef-ac86-0e0b76f78667 admin admin] PATH_INFO: `/v3/projects` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.026068 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c501d3-fe05-42ef-ac86-0e0b76f78667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.028123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c501d3-fe05-42ef-ac86-0e0b76f78667 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.067378 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 581/1178] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Jun 25 20:47:16 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 25 20:47:16.070895 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c501d3-fe05-42ef-ac86-0e0b76f78667 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.118032 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 598/1179] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:15 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:47:16.122726 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bafa7-ae70-4c79-a1d0-6bf00c9017d6 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.135896 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0bafa7-ae70-4c79-a1d0-6bf00c9017d6 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.159582 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:16.168005 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c501d3-fe05-42ef-ac86-0e0b76f78667 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.177587 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321911e-841e-47ac-bd97-5fef812ea5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.178288 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321911e-841e-47ac-bd97-5fef812ea5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.178613 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321911e-841e-47ac-bd97-5fef812ea5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.178893 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321911e-841e-47ac-bd97-5fef812ea5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.179615 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321911e-841e-47ac-bd97-5fef812ea5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.181678 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321911e-841e-47ac-bd97-5fef812ea5a7 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.225353 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 582/1180] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Jun 25 20:47:16 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:47:16.231864 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754459-9c71-4f72-8956-8ce1887c1747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.232543 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321911e-841e-47ac-bd97-5fef812ea5a7 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.232822 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754459-9c71-4f72-8956-8ce1887c1747 admin admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.233207 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754459-9c71-4f72-8956-8ce1887c1747 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.233588 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea754459-9c71-4f72-8956-8ce1887c1747 admin admin] PATH_INFO: `/v3/projects` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.234992 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea754459-9c71-4f72-8956-8ce1887c1747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.237078 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea754459-9c71-4f72-8956-8ce1887c1747 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.243796 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321911e-841e-47ac-bd97-5fef812ea5a7 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.255069 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33541d23-4a16-4828-814d-d56d64e01aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.255768 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541d23-4a16-4828-814d-d56d64e01aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.256057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541d23-4a16-4828-814d-d56d64e01aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.256336 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33541d23-4a16-4828-814d-d56d64e01aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.257079 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33541d23-4a16-4828-814d-d56d64e01aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.259779 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33541d23-4a16-4828-814d-d56d64e01aa6 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.273154 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 583/1181] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:47:16.276995 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33541d23-4a16-4828-814d-d56d64e01aa6 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.281890 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 599/1182] 10.222.0.26 () {60 vars in 1152 bytes} [Sat Jun 25 20:47:16 2022] POST /identity/v3/projects => generated 379 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:47:16.284109 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754459-9c71-4f72-8956-8ce1887c1747 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.292981 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:16.294731 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33541d23-4a16-4828-814d-d56d64e01aa6 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.382252 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea754459-9c71-4f72-8956-8ce1887c1747 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.387198 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155838-cb93-4a00-b890-c68c57400d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.388439 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155838-cb93-4a00-b890-c68c57400d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.388835 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155838-cb93-4a00-b890-c68c57400d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.389378 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c155838-cb93-4a00-b890-c68c57400d4b admin admin] PATH_INFO: `/v3/projects/7641bdeff29f4c56aa3d221bbafacc30/users/19622c4f40d94c5c88d4182a95b92f4b/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.395120 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce41c27-891a-49a6-bb16-ec6e217e2b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.395941 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce41c27-891a-49a6-bb16-ec6e217e2b20 admin admin] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.396333 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce41c27-891a-49a6-bb16-ec6e217e2b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.396964 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce41c27-891a-49a6-bb16-ec6e217e2b20 admin admin] PATH_INFO: `/v3/users` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.397787 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce41c27-891a-49a6-bb16-ec6e217e2b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.400134 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce41c27-891a-49a6-bb16-ec6e217e2b20 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.408112 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c155838-cb93-4a00-b890-c68c57400d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7641bdeff29f4c56aa3d221bbafacc30, user_id=19622c4f40d94c5c88d4182a95b92f4b, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.411126 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c155838-cb93-4a00-b890-c68c57400d4b admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.430818 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 584/1183] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Jun 25 20:47:16 2022] PUT /identity/v3/projects/7641bdeff29f4c56aa3d221bbafacc30/users/19622c4f40d94c5c88d4182a95b92f4b/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:47:16.435457 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 600/1184] 10.222.0.26 () {60 vars in 1143 bytes} [Sat Jun 25 20:47:16 2022] POST /identity/v3/users => generated 296 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 25 20:47:16.443587 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce41c27-891a-49a6-bb16-ec6e217e2b20 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.447822 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155838-cb93-4a00-b890-c68c57400d4b admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.462263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce41c27-891a-49a6-bb16-ec6e217e2b20 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.540280 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c155838-cb93-4a00-b890-c68c57400d4b admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.545782 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f91c5-4988-4083-a72c-3dc264be4ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.546528 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f91c5-4988-4083-a72c-3dc264be4ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.546846 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f91c5-4988-4083-a72c-3dc264be4ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.547162 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f91c5-4988-4083-a72c-3dc264be4ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.547934 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f91c5-4988-4083-a72c-3dc264be4ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.550018 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f91c5-4988-4083-a72c-3dc264be4ce6 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.553511 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452c296-7bf0-491d-ad47-6ee15be417f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.554504 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452c296-7bf0-491d-ad47-6ee15be417f7 admin admin] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.555393 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452c296-7bf0-491d-ad47-6ee15be417f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.555885 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e452c296-7bf0-491d-ad47-6ee15be417f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.556861 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452c296-7bf0-491d-ad47-6ee15be417f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.559351 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e452c296-7bf0-491d-ad47-6ee15be417f7 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.561923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 585/1185] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:47:16.565627 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f91c5-4988-4083-a72c-3dc264be4ce6 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.571929 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 601/1186] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 25 20:47:16.578316 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452c296-7bf0-491d-ad47-6ee15be417f7 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.592047 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f91c5-4988-4083-a72c-3dc264be4ce6 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.599083 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e452c296-7bf0-491d-ad47-6ee15be417f7 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.600984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748f1d0-4324-428c-8f74-d3f78fa57810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.602438 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748f1d0-4324-428c-8f74-d3f78fa57810 admin admin] REQUEST_METHOD: `PUT` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.602824 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748f1d0-4324-428c-8f74-d3f78fa57810 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.603184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748f1d0-4324-428c-8f74-d3f78fa57810 admin admin] PATH_INFO: `/v3/projects/7641bdeff29f4c56aa3d221bbafacc30/users/19622c4f40d94c5c88d4182a95b92f4b/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.605255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1dc9-2b66-438a-8bc9-19f9de913bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.605571 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748f1d0-4324-428c-8f74-d3f78fa57810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7641bdeff29f4c56aa3d221bbafacc30, user_id=19622c4f40d94c5c88d4182a95b92f4b, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.606499 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1dc9-2b66-438a-8bc9-19f9de913bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.606996 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1dc9-2b66-438a-8bc9-19f9de913bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.607378 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca1dc9-2b66-438a-8bc9-19f9de913bc3 admin admin] PATH_INFO: `/v3/projects/6d233b6ef49942f29b46fc60534f3f1d/users/4a74ba2694954362be2fc80547b5727d/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.609753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c748f1d0-4324-428c-8f74-d3f78fa57810 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.626696 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 586/1187] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Jun 25 20:47:16 2022] PUT /identity/v3/projects/7641bdeff29f4c56aa3d221bbafacc30/users/19622c4f40d94c5c88d4182a95b92f4b/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:47:16.633406 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca1dc9-2b66-438a-8bc9-19f9de913bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d233b6ef49942f29b46fc60534f3f1d, user_id=4a74ba2694954362be2fc80547b5727d, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.636867 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca1dc9-2b66-438a-8bc9-19f9de913bc3 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.659266 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 602/1188] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Jun 25 20:47:16 2022] PUT /identity/v3/projects/6d233b6ef49942f29b46fc60534f3f1d/users/4a74ba2694954362be2fc80547b5727d/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:47:16.663561 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748f1d0-4324-428c-8f74-d3f78fa57810 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.735956 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:16.773980 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748f1d0-4324-428c-8f74-d3f78fa57810 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.865556 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8987d9a-006c-4722-a804-7ca379e2cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.866195 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8987d9a-006c-4722-a804-7ca379e2cd68 admin admin] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.866706 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8987d9a-006c-4722-a804-7ca379e2cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.866706 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8987d9a-006c-4722-a804-7ca379e2cd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.867985 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8987d9a-006c-4722-a804-7ca379e2cd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.869690 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8987d9a-006c-4722-a804-7ca379e2cd68 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.880247 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 587/1189] 10.222.0.26 () {58 vars in 1121 bytes} [Sat Jun 25 20:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 25 20:47:16.884711 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1dc9-2b66-438a-8bc9-19f9de913bc3 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:16.896264 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca1dc9-2b66-438a-8bc9-19f9de913bc3 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:16.901116 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c97a21-9e69-4443-ab05-3654db1555f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:16.902108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c97a21-9e69-4443-ab05-3654db1555f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:16.902614 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c97a21-9e69-4443-ab05-3654db1555f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:16.902955 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c97a21-9e69-4443-ab05-3654db1555f4 admin admin] PATH_INFO: `/v3/projects/6d233b6ef49942f29b46fc60534f3f1d/users/4a74ba2694954362be2fc80547b5727d/roles/8e22816a513845d88f4934c2164a142b` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:16.905082 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c97a21-9e69-4443-ab05-3654db1555f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d233b6ef49942f29b46fc60534f3f1d, user_id=4a74ba2694954362be2fc80547b5727d, role_id=8e22816a513845d88f4934c2164a142b)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:16.907887 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c97a21-9e69-4443-ab05-3654db1555f4 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:16.932998 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 603/1190] 10.222.0.26 () {60 vars in 1482 bytes} [Sat Jun 25 20:47:16 2022] PUT /identity/v3/projects/6d233b6ef49942f29b46fc60534f3f1d/users/4a74ba2694954362be2fc80547b5727d/roles/8e22816a513845d88f4934c2164a142b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:47:22.086509 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dc791-29fe-4904-8a81-202b4b981152 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:22.086990 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dc791-29fe-4904-8a81-202b4b981152 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:22.087223 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dc791-29fe-4904-8a81-202b4b981152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:22.182515 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-0c9dc791-29fe-4904-8a81-202b4b981152 None None] MFA Rules not processed for user `19622c4f40d94c5c88d4182a95b92f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:22.185287 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-0c9dc791-29fe-4904-8a81-202b4b981152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:22.309560 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 588/1191] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:22 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:22.328622 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c97a21-9e69-4443-ab05-3654db1555f4 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:22.330605 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-d3c97a21-9e69-4443-ab05-3654db1555f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:22.444097 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:22.467501 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c97a21-9e69-4443-ab05-3654db1555f4 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:22.476204 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf26b72-d0e9-4dbe-9cad-3fa94a2e081e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e58f00fa06e4a1ca16f5f8eba3dfb0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:22.478250 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf26b72-d0e9-4dbe-9cad-3fa94a2e081e service glance] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:22.478400 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf26b72-d0e9-4dbe-9cad-3fa94a2e081e service glance] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:22.479327 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf26b72-d0e9-4dbe-9cad-3fa94a2e081e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:22.587143 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf26b72-d0e9-4dbe-9cad-3fa94a2e081e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:22.588760 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf26b72-d0e9-4dbe-9cad-3fa94a2e081e service glance] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:22.600728 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 604/1192] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:22 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:47:22.719104 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854ce4-6f3b-4d27-b6c3-8af70d8fd05d None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:22.719513 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854ce4-6f3b-4d27-b6c3-8af70d8fd05d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:22.719838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40854ce4-6f3b-4d27-b6c3-8af70d8fd05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:22.772790 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-40854ce4-6f3b-4d27-b6c3-8af70d8fd05d None None] MFA Rules not processed for user `4a74ba2694954362be2fc80547b5727d`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:22.774527 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-40854ce4-6f3b-4d27-b6c3-8af70d8fd05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:22.902087 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=100 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:22.933589 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 589/1193] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:22 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:22.949775 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf26b72-d0e9-4dbe-9cad-3fa94a2e081e service glance] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:22.965754 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf26b72-d0e9-4dbe-9cad-3fa94a2e081e service glance] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:22.977606 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd9f03-cfc6-4806-b366-1399c08d8bcf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e58f00fa06e4a1ca16f5f8eba3dfb0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:22.978302 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd9f03-cfc6-4806-b366-1399c08d8bcf service glance] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:22.978624 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd9f03-cfc6-4806-b366-1399c08d8bcf service glance] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:22.979890 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd9f03-cfc6-4806-b366-1399c08d8bcf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:23.180237 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd9f03-cfc6-4806-b366-1399c08d8bcf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:23.183243 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fd9f03-cfc6-4806-b366-1399c08d8bcf service glance] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:23.203146 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 605/1194] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:22 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:47:31.721735 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc7407-f25f-4c71-8c38-e5967fb34b6d None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:31.722349 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc7407-f25f-4c71-8c38-e5967fb34b6d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:31.722349 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc7407-f25f-4c71-8c38-e5967fb34b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:31.740322 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-eebc7407-f25f-4c71-8c38-e5967fb34b6d None None] MFA Rules not processed for user `490615605dbf4c4cb609d401ce2e8505`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:31.741533 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-eebc7407-f25f-4c71-8c38-e5967fb34b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:31.748592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 590/1195] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:47:31 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:32.044715 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa7d64-e6f0-4e89-a300-295aeebc11b9 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:32.045741 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa7d64-e6f0-4e89-a300-295aeebc11b9 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:32.046017 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa7d64-e6f0-4e89-a300-295aeebc11b9 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:32.048071 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 606/1196] 10.222.0.26 () {54 vars in 961 bytes} [Sat Jun 25 20:47:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:47:32.053199 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00d92-176b-48fc-95d3-31e0384faeea None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:32.053542 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00d92-176b-48fc-95d3-31e0384faeea None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:32.053801 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe00d92-176b-48fc-95d3-31e0384faeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:32.087979 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-afe00d92-176b-48fc-95d3-31e0384faeea None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:32.089735 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-afe00d92-176b-48fc-95d3-31e0384faeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:32.154096 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 591/1197] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Jun 25 20:47:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:32.159791 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc082d-782a-4f6c-9a55-f85616ceddd0 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:32.160088 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc082d-782a-4f6c-9a55-f85616ceddd0 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:32.160368 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc082d-782a-4f6c-9a55-f85616ceddd0 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:32.161753 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 607/1198] 10.222.0.26 () {54 vars in 912 bytes} [Sat Jun 25 20:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:47:32.166916 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dce20-2a2e-42ea-8866-34f901109bc0 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:32.167211 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dce20-2a2e-42ea-8866-34f901109bc0 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:32.167489 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1dce20-2a2e-42ea-8866-34f901109bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:32.185993 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-cb1dce20-2a2e-42ea-8866-34f901109bc0 None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:32.187192 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-cb1dce20-2a2e-42ea-8866-34f901109bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:32.195930 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 592/1199] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Jun 25 20:47:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:32.208291 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc082d-782a-4f6c-9a55-f85616ceddd0 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:32.210307 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-05cc082d-782a-4f6c-9a55-f85616ceddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:32.225170 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc082d-782a-4f6c-9a55-f85616ceddd0 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:32.228947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c7de8-87b0-41a6-a038-146d5711a028 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e58f00fa06e4a1ca16f5f8eba3dfb0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:32.229686 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c7de8-87b0-41a6-a038-146d5711a028 service glance] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:32.229917 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c7de8-87b0-41a6-a038-146d5711a028 service glance] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:32.230208 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c7de8-87b0-41a6-a038-146d5711a028 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:32.240488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c7de8-87b0-41a6-a038-146d5711a028 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:32.242136 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c7de8-87b0-41a6-a038-146d5711a028 service glance] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:32.253560 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 608/1200] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:47:32.592686 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aebd2f-7bf2-4bd0-9c0e-e987acc344c7 None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:32.593023 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aebd2f-7bf2-4bd0-9c0e-e987acc344c7 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:32.593263 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aebd2f-7bf2-4bd0-9c0e-e987acc344c7 None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:32.594742 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 593/1201] 10.222.0.26 () {54 vars in 912 bytes} [Sat Jun 25 20:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:47:32.600596 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba909-2327-4cf1-a501-311f7cf1d56c None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:32.600842 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba909-2327-4cf1-a501-311f7cf1d56c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:32.601713 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dba909-2327-4cf1-a501-311f7cf1d56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:32.633443 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-77dba909-2327-4cf1-a501-311f7cf1d56c None None] MFA Rules not processed for user `6ddd2eb988484d7ab0e64323fe4f4602`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:32.634717 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-77dba909-2327-4cf1-a501-311f7cf1d56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:32.685160 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 609/1202] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Jun 25 20:47:32 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:32.696817 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aebd2f-7bf2-4bd0-9c0e-e987acc344c7 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:32.709060 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aebd2f-7bf2-4bd0-9c0e-e987acc344c7 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:32.715348 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e2333-c595-4029-83a0-f36264cce378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:32.716648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2333-c595-4029-83a0-f36264cce378 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:32.716648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2333-c595-4029-83a0-f36264cce378 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:32.716648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e2333-c595-4029-83a0-f36264cce378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:32.725402 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e2333-c595-4029-83a0-f36264cce378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:32.727376 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e2333-c595-4029-83a0-f36264cce378 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:32.736683 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 594/1203] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:32 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:47:33.169282 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c57658-8f35-4ba4-a75d-fecd671fcf8b None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:33.169900 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c57658-8f35-4ba4-a75d-fecd671fcf8b None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:33.169900 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c57658-8f35-4ba4-a75d-fecd671fcf8b None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:33.171687 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 610/1204] 10.222.0.26 () {54 vars in 961 bytes} [Sat Jun 25 20:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:47:33.177913 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987577f-b109-42f5-96be-8d649a838424 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:33.178243 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987577f-b109-42f5-96be-8d649a838424 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:33.178566 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987577f-b109-42f5-96be-8d649a838424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:33.203485 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-f987577f-b109-42f5-96be-8d649a838424 None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:33.205320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-f987577f-b109-42f5-96be-8d649a838424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:33.215197 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 595/1205] 10.222.0.26 () {58 vars in 1058 bytes} [Sat Jun 25 20:47:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:33.217232 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cdc97-b529-4ff0-a536-f5e5971fd2d2 None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:33.218755 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cdc97-b529-4ff0-a536-f5e5971fd2d2 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:33.219218 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cdc97-b529-4ff0-a536-f5e5971fd2d2 None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:33.220111 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65cd00-1686-4a8a-92eb-ed2e4397330f None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:33.220403 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65cd00-1686-4a8a-92eb-ed2e4397330f None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:33.220737 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de65cd00-1686-4a8a-92eb-ed2e4397330f None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:33.222230 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 611/1206] 10.222.0.26 () {54 vars in 960 bytes} [Sat Jun 25 20:47:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:47:33.226995 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 596/1207] 10.222.0.26 () {54 vars in 912 bytes} [Sat Jun 25 20:47:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:47:33.228397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651151-3422-4e1a-ad82-5e83e12565f8 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:33.228753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8328c-4346-41aa-bcfc-17adda4a9605 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:33.229266 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8328c-4346-41aa-bcfc-17adda4a9605 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:33.229585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8328c-4346-41aa-bcfc-17adda4a9605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:33.229933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651151-3422-4e1a-ad82-5e83e12565f8 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:33.230636 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb651151-3422-4e1a-ad82-5e83e12565f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:33.249865 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-d8f8328c-4346-41aa-bcfc-17adda4a9605 None None] MFA Rules not processed for user `d91c64b1ed4e49c7870ac00844b29bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:33.251753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-d8f8328c-4346-41aa-bcfc-17adda4a9605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:33.257095 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-fb651151-3422-4e1a-ad82-5e83e12565f8 None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:33.259105 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-fb651151-3422-4e1a-ad82-5e83e12565f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:33.270350 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 612/1208] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Jun 25 20:47:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 25 20:47:33.283519 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb651151-3422-4e1a-ad82-5e83e12565f8 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:33.295630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb651151-3422-4e1a-ad82-5e83e12565f8 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:33.299883 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2af5b-b6c6-4699-b76b-22a774c11ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:33.301051 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2af5b-b6c6-4699-b76b-22a774c11ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:33.301347 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2af5b-b6c6-4699-b76b-22a774c11ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:33.301637 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2af5b-b6c6-4699-b76b-22a774c11ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:33.314847 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2af5b-b6c6-4699-b76b-22a774c11ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:33.316317 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2af5b-b6c6-4699-b76b-22a774c11ff9 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:33.322889 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=100 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:33.332170 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 613/1209] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:47:33.388695 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 597/1210] 10.222.0.26 () {58 vars in 1057 bytes} [Sat Jun 25 20:47:33 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:33.398030 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2af5b-b6c6-4699-b76b-22a774c11ff9 service neutron] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:33.411817 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2af5b-b6c6-4699-b76b-22a774c11ff9 service neutron] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:33.418219 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ac6a3-a8c8-4ec9-813e-eec5a6b920e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91c64b1ed4e49c7870ac00844b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:33.418962 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ac6a3-a8c8-4ec9-813e-eec5a6b920e8 service placement] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:33.419250 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ac6a3-a8c8-4ec9-813e-eec5a6b920e8 service placement] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:33.419942 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ac6a3-a8c8-4ec9-813e-eec5a6b920e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:33.422447 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-dc0ac6a3-a8c8-4ec9-813e-eec5a6b920e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:33.442055 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ac6a3-a8c8-4ec9-813e-eec5a6b920e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:33.443853 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ac6a3-a8c8-4ec9-813e-eec5a6b920e8 service placement] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:33.454649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 614/1211] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:33 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:47:43.373999 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=80 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:43.450059 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=6 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:47:45.724826 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc9c6-4a56-45cd-9001-bacb806b02bc None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:45.725414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc9c6-4a56-45cd-9001-bacb806b02bc None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:45.725414 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc9c6-4a56-45cd-9001-bacb806b02bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:45.747172 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-d87cc9c6-4a56-45cd-9001-bacb806b02bc None None] MFA Rules not processed for user `6ddd2eb988484d7ab0e64323fe4f4602`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:45.748639 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-d87cc9c6-4a56-45cd-9001-bacb806b02bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:45.756362 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 598/1212] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Jun 25 20:47:45 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:45.768374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ac6a3-a8c8-4ec9-813e-eec5a6b920e8 service placement] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:45.778017 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ac6a3-a8c8-4ec9-813e-eec5a6b920e8 service placement] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:45.781776 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4c41-e4d2-4421-831e-a4b67fe3018f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:45.782459 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4c41-e4d2-4421-831e-a4b67fe3018f service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:45.782725 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4c41-e4d2-4421-831e-a4b67fe3018f service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:45.783006 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4c41-e4d2-4421-831e-a4b67fe3018f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:45.791103 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4c41-e4d2-4421-831e-a4b67fe3018f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:45.792564 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd4c41-e4d2-4421-831e-a4b67fe3018f service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:45.801570 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 615/1213] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:45 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:47:46.778637 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f1b1-1c5c-4f95-898f-b8ff38995bdb None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:46.779175 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f1b1-1c5c-4f95-898f-b8ff38995bdb None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:46.779387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86f1b1-1c5c-4f95-898f-b8ff38995bdb None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:46.781378 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 599/1214] 10.222.0.26 () {54 vars in 921 bytes} [Sat Jun 25 20:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:47:46.815587 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f054c2-5ff6-4358-b38e-00e8b1f249cd None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:46.816096 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f054c2-5ff6-4358-b38e-00e8b1f249cd None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:46.816332 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f054c2-5ff6-4358-b38e-00e8b1f249cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:46.869021 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-77f054c2-5ff6-4358-b38e-00e8b1f249cd None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:46.871461 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-77f054c2-5ff6-4358-b38e-00e8b1f249cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:46.883646 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 616/1215] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Jun 25 20:47:46 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:46.935746 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f1b1-1c5c-4f95-898f-b8ff38995bdb None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:46.953026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86f1b1-1c5c-4f95-898f-b8ff38995bdb None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:46.959642 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e973296-7cd3-46e1-9f66-17ee96dc9912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:46.960951 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e973296-7cd3-46e1-9f66-17ee96dc9912 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:46.961100 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e973296-7cd3-46e1-9f66-17ee96dc9912 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:46.961387 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e973296-7cd3-46e1-9f66-17ee96dc9912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:46.972797 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e973296-7cd3-46e1-9f66-17ee96dc9912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:46.974877 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e973296-7cd3-46e1-9f66-17ee96dc9912 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:46.986449 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 600/1216] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:46 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:47:54.104914 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705853-c910-49b1-8aef-1f0783369deb None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:54.105551 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705853-c910-49b1-8aef-1f0783369deb None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:54.105551 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0705853-c910-49b1-8aef-1f0783369deb None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:54.106900 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 617/1217] 10.222.0.26 () {54 vars in 921 bytes} [Sat Jun 25 20:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:47:54.116213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a4a24-0a11-4039-8e67-540d5727e97b None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:54.116935 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a4a24-0a11-4039-8e67-540d5727e97b None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:54.116935 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a4a24-0a11-4039-8e67-540d5727e97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:54.140984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-115a4a24-0a11-4039-8e67-540d5727e97b None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:47:54.142393 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-115a4a24-0a11-4039-8e67-540d5727e97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:47:54.153482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 601/1218] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Jun 25 20:47:54 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:47:54.173649 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705853-c910-49b1-8aef-1f0783369deb None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:47:54.189073 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0705853-c910-49b1-8aef-1f0783369deb None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:47:54.198481 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19746157-65f7-4be5-8463-0ae80693f4a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:47:54.199776 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19746157-65f7-4be5-8463-0ae80693f4a2 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:47:54.200067 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19746157-65f7-4be5-8463-0ae80693f4a2 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:47:54.200344 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19746157-65f7-4be5-8463-0ae80693f4a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:47:54.209293 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19746157-65f7-4be5-8463-0ae80693f4a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:47:54.210953 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19746157-65f7-4be5-8463-0ae80693f4a2 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:47:54.221200 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 618/1219] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:47:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:48:04.133467 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=12 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:48:04.216893 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=15 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:48:06.057426 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a4a24-0a11-4039-8e67-540d5727e97b None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:48:06.066795 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a4a24-0a11-4039-8e67-540d5727e97b None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:48:06.070547 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818ec35-37ba-4b5f-9562-faf1588ae1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:48:06.071213 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818ec35-37ba-4b5f-9562-faf1588ae1bb service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:48:06.071618 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818ec35-37ba-4b5f-9562-faf1588ae1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:48:06.071903 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818ec35-37ba-4b5f-9562-faf1588ae1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:48:06.082815 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818ec35-37ba-4b5f-9562-faf1588ae1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:48:06.084397 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818ec35-37ba-4b5f-9562-faf1588ae1bb service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:48:06.094496 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 602/1220] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:48:06 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:48:16.090610 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=6 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:48:25.099659 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5163cdb-a4e7-4ea4-8f1c-d4d2f44345dd None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:48:25.100263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5163cdb-a4e7-4ea4-8f1c-d4d2f44345dd None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:48:25.100263 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5163cdb-a4e7-4ea4-8f1c-d4d2f44345dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:48:25.120315 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-f5163cdb-a4e7-4ea4-8f1c-d4d2f44345dd None None] MFA Rules not processed for user `39b53390061840f4bc577c5f507fabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:48:25.121523 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-f5163cdb-a4e7-4ea4-8f1c-d4d2f44345dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:48:25.132104 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 619/1221] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:48:25 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:48:25.639644 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58010306-d520-4f75-b4ac-69cce9c2d181 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:48:25.640391 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58010306-d520-4f75-b4ac-69cce9c2d181 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:48:25.640503 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58010306-d520-4f75-b4ac-69cce9c2d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:48:25.665687 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-58010306-d520-4f75-b4ac-69cce9c2d181 None None] MFA Rules not processed for user `6ddd2eb988484d7ab0e64323fe4f4602`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:48:25.666959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-58010306-d520-4f75-b4ac-69cce9c2d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:48:25.674959 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 603/1222] 10.222.0.26 () {58 vars in 1009 bytes} [Sat Jun 25 20:48:25 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:48:25.690268 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5163cdb-a4e7-4ea4-8f1c-d4d2f44345dd None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:48:25.703790 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5163cdb-a4e7-4ea4-8f1c-d4d2f44345dd None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:48:25.708255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d6f95-418d-4a54-b3f2-ce24bd08dab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:48:25.708897 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d6f95-418d-4a54-b3f2-ce24bd08dab9 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:48:25.709182 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d6f95-418d-4a54-b3f2-ce24bd08dab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:48:25.709469 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d6f95-418d-4a54-b3f2-ce24bd08dab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:48:25.717069 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d6f95-418d-4a54-b3f2-ce24bd08dab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:48:25.718563 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d6f95-418d-4a54-b3f2-ce24bd08dab9 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:48:25.727123 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 620/1223] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:48:25 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:48:35.660089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:48:35.723747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=9 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:48:50.849270 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c70076-f6db-4744-b02d-446f5ac7bc79 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:48:50.849788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c70076-f6db-4744-b02d-446f5ac7bc79 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:48:50.849788 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c70076-f6db-4744-b02d-446f5ac7bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:48:50.873758 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-34c70076-f6db-4744-b02d-446f5ac7bc79 None None] MFA Rules not processed for user `39b53390061840f4bc577c5f507fabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:48:50.875004 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-34c70076-f6db-4744-b02d-446f5ac7bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:48:50.883965 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 604/1224] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:48:50 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:49:00.867769 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:49:05.697448 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78787-fc8e-4b09-a714-a12a2d216a80 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:49:05.697991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78787-fc8e-4b09-a714-a12a2d216a80 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:49:05.697991 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78787-fc8e-4b09-a714-a12a2d216a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:49:05.716650 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-21e78787-fc8e-4b09-a714-a12a2d216a80 None None] MFA Rules not processed for user `39b53390061840f4bc577c5f507fabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:49:05.717864 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-21e78787-fc8e-4b09-a714-a12a2d216a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:49:05.725849 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 621/1225] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:49:05 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:49:15.711744 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=3 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:03.675543 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f74773-d27f-4404-91e6-e8591b0f3bef None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:03.676066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f74773-d27f-4404-91e6-e8591b0f3bef None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:03.676066 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f74773-d27f-4404-91e6-e8591b0f3bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:03.695395 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-c7f74773-d27f-4404-91e6-e8591b0f3bef None None] MFA Rules not processed for user `39b53390061840f4bc577c5f507fabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:50:03.696769 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-c7f74773-d27f-4404-91e6-e8591b0f3bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:50:03.705210 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 605/1226] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:50:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:50:13.690221 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:18.003283 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e78787-fc8e-4b09-a714-a12a2d216a80 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:50:18.023420 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e78787-fc8e-4b09-a714-a12a2d216a80 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:50:18.027374 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362acc6-1a57-4ba3-bb7e-deb20b9af1d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:50:18.028017 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362acc6-1a57-4ba3-bb7e-deb20b9af1d1 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:18.028305 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362acc6-1a57-4ba3-bb7e-deb20b9af1d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:18.028577 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362acc6-1a57-4ba3-bb7e-deb20b9af1d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:18.038558 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362acc6-1a57-4ba3-bb7e-deb20b9af1d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:50:18.040002 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362acc6-1a57-4ba3-bb7e-deb20b9af1d1 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:50:18.049559 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 622/1227] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:50:18 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:50:20.022665 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c957a-76a8-46d4-9d39-96212e76bfda None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:20.023185 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c957a-76a8-46d4-9d39-96212e76bfda None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:20.023261 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c957a-76a8-46d4-9d39-96212e76bfda None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:20.024689 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 606/1228] 10.222.0.26 () {54 vars in 921 bytes} [Sat Jun 25 20:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:50:20.030408 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a73da-61c7-4524-acd3-261bb553a72a None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:20.031044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a73da-61c7-4524-acd3-261bb553a72a None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:20.031044 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a73da-61c7-4524-acd3-261bb553a72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:20.087028 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-5d4a73da-61c7-4524-acd3-261bb553a72a None None] MFA Rules not processed for user `bf16c49c506a4f5c86e3538cd3ed12be`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:50:20.088337 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-5d4a73da-61c7-4524-acd3-261bb553a72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:50:20.106760 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 623/1229] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Jun 25 20:50:20 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:50:20.119087 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c957a-76a8-46d4-9d39-96212e76bfda None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:50:20.132871 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4c957a-76a8-46d4-9d39-96212e76bfda None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:50:20.138184 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbce5ae-c459-4a0c-adc2-db6e0e97aff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:50:20.139070 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbce5ae-c459-4a0c-adc2-db6e0e97aff0 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:50:20.139363 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbce5ae-c459-4a0c-adc2-db6e0e97aff0 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:50:20.139641 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbce5ae-c459-4a0c-adc2-db6e0e97aff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:50:20.148800 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbce5ae-c459-4a0c-adc2-db6e0e97aff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:50:20.150497 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbce5ae-c459-4a0c-adc2-db6e0e97aff0 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:50:20.161320 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 607/1230] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:50:20 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:50:30.103927 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=27 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:50:30.157300 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=6 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:51:34.571472 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a73da-61c7-4524-acd3-261bb553a72a None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:51:34.593137 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a73da-61c7-4524-acd3-261bb553a72a None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:51:34.599677 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e337c-baf1-44a9-9c13-93087fccde01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91c64b1ed4e49c7870ac00844b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:51:34.600322 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e337c-baf1-44a9-9c13-93087fccde01 service placement] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:51:34.600624 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e337c-baf1-44a9-9c13-93087fccde01 service placement] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:51:34.600904 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e337c-baf1-44a9-9c13-93087fccde01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:51:34.609603 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e337c-baf1-44a9-9c13-93087fccde01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:51:34.611242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e337c-baf1-44a9-9c13-93087fccde01 service placement] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:51:34.623805 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 624/1231] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:51:34 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:51:44.617152 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=10 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:25.538399 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbce5ae-c459-4a0c-adc2-db6e0e97aff0 service nova] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:25.552568 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbce5ae-c459-4a0c-adc2-db6e0e97aff0 service nova] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:25.560807 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baeaa8-cd52-4ad4-ad58-e7b80f85d748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:25.561708 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baeaa8-cd52-4ad4-ad58-e7b80f85d748 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:25.562084 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baeaa8-cd52-4ad4-ad58-e7b80f85d748 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:25.562450 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37baeaa8-cd52-4ad4-ad58-e7b80f85d748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:25.572343 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baeaa8-cd52-4ad4-ad58-e7b80f85d748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:25.573939 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37baeaa8-cd52-4ad4-ad58-e7b80f85d748 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:25.583187 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 608/1232] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:25 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:29.238074 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437511c-a399-43d6-9071-4089bfd7d261 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:29.238630 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437511c-a399-43d6-9071-4089bfd7d261 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:29.238875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437511c-a399-43d6-9071-4089bfd7d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:29.257131 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-7437511c-a399-43d6-9071-4089bfd7d261 None None] MFA Rules not processed for user `39b53390061840f4bc577c5f507fabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:29.258274 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-7437511c-a399-43d6-9071-4089bfd7d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:29.265776 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 625/1233] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:52:29 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:32.295674 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baeaa8-cd52-4ad4-ad58-e7b80f85d748 service nova] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:32.305707 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37baeaa8-cd52-4ad4-ad58-e7b80f85d748 service nova] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:32.309265 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd91d9e-f24c-4257-ba3f-8ca9e75fa529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:32.309922 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd91d9e-f24c-4257-ba3f-8ca9e75fa529 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:32.310208 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd91d9e-f24c-4257-ba3f-8ca9e75fa529 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:32.310529 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd91d9e-f24c-4257-ba3f-8ca9e75fa529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:32.324269 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd91d9e-f24c-4257-ba3f-8ca9e75fa529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:32.325740 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd91d9e-f24c-4257-ba3f-8ca9e75fa529 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:32.337337 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 609/1234] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:32 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:34.798858 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437511c-a399-43d6-9071-4089bfd7d261 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:34.809595 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437511c-a399-43d6-9071-4089bfd7d261 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:34.814399 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafdb2b0-bc5d-4628-b04b-2fbde15ca0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:34.815083 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdb2b0-bc5d-4628-b04b-2fbde15ca0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:34.815417 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdb2b0-bc5d-4628-b04b-2fbde15ca0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:34.815698 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafdb2b0-bc5d-4628-b04b-2fbde15ca0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:34.825881 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdb2b0-bc5d-4628-b04b-2fbde15ca0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:34.827365 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafdb2b0-bc5d-4628-b04b-2fbde15ca0b4 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:34.837801 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 626/1235] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:41.281885 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd91d9e-f24c-4257-ba3f-8ca9e75fa529 service neutron] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:41.293621 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd91d9e-f24c-4257-ba3f-8ca9e75fa529 service neutron] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:41.299277 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb067b-2a02-43f7-838b-62835a461da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:41.299953 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb067b-2a02-43f7-838b-62835a461da2 service nova] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:41.300239 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb067b-2a02-43f7-838b-62835a461da2 service nova] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:41.300555 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb067b-2a02-43f7-838b-62835a461da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:41.309938 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb067b-2a02-43f7-838b-62835a461da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:41.311658 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb067b-2a02-43f7-838b-62835a461da2 service nova] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:41.322265 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 610/1236] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:41 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:44.833331 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=9 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:51.317882 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=18 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:52:57.430969 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69156d9f-6389-4568-979e-d779ffd95a1c None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:57.431488 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69156d9f-6389-4568-979e-d779ffd95a1c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:57.431579 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69156d9f-6389-4568-979e-d779ffd95a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:57.458578 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-69156d9f-6389-4568-979e-d779ffd95a1c None None] MFA Rules not processed for user `490615605dbf4c4cb609d401ce2e8505`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:52:57.459785 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-69156d9f-6389-4568-979e-d779ffd95a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:52:57.470654 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 627/1237] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:52:57 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:52:57.728804 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb067b-2a02-43f7-838b-62835a461da2 service nova] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:57.738838 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb067b-2a02-43f7-838b-62835a461da2 service nova] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:57.742984 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654f8ec-d481-4a8f-9515-8024ed1dde14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:57.743628 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654f8ec-d481-4a8f-9515-8024ed1dde14 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:57.743918 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654f8ec-d481-4a8f-9515-8024ed1dde14 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:57.744203 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654f8ec-d481-4a8f-9515-8024ed1dde14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:57.751813 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654f8ec-d481-4a8f-9515-8024ed1dde14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:57.753309 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654f8ec-d481-4a8f-9515-8024ed1dde14 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:57.761248 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 611/1238] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:57 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:52:58.100747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69156d9f-6389-4568-979e-d779ffd95a1c None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:52:58.113707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69156d9f-6389-4568-979e-d779ffd95a1c None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:52:58.119859 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f807a0-6cb3-42db-bb99-4d2250477799 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91c64b1ed4e49c7870ac00844b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:52:58.120510 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f807a0-6cb3-42db-bb99-4d2250477799 service placement] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:52:58.120796 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f807a0-6cb3-42db-bb99-4d2250477799 service placement] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:52:58.121080 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f807a0-6cb3-42db-bb99-4d2250477799 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:52:58.130634 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f807a0-6cb3-42db-bb99-4d2250477799 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:52:58.132242 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f807a0-6cb3-42db-bb99-4d2250477799 service placement] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:52:58.142935 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 628/1239] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:52:58 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:07.757753 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=6 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:08.138255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=9 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:09.214803 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654f8ec-d481-4a8f-9515-8024ed1dde14 service neutron] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:09.224878 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654f8ec-d481-4a8f-9515-8024ed1dde14 service neutron] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:09.229144 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7506e2-5b2f-4790-b2ff-201904cfe987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:09.229812 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7506e2-5b2f-4790-b2ff-201904cfe987 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:09.230103 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7506e2-5b2f-4790-b2ff-201904cfe987 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:09.230378 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7506e2-5b2f-4790-b2ff-201904cfe987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:09.238520 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7506e2-5b2f-4790-b2ff-201904cfe987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:09.240027 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7506e2-5b2f-4790-b2ff-201904cfe987 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:09.248673 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 612/1240] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:09 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:15.764397 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f807a0-6cb3-42db-bb99-4d2250477799 service placement] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:15.776292 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f807a0-6cb3-42db-bb99-4d2250477799 service placement] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:15.783709 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97fd29-4f96-4c70-96d1-a2952e8af5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:15.784382 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97fd29-4f96-4c70-96d1-a2952e8af5e0 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:15.784676 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97fd29-4f96-4c70-96d1-a2952e8af5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:15.785156 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97fd29-4f96-4c70-96d1-a2952e8af5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:15.795650 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97fd29-4f96-4c70-96d1-a2952e8af5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:15.797345 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97fd29-4f96-4c70-96d1-a2952e8af5e0 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:15.808916 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 629/1241] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:15 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:19.245256 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=6 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:23.975177 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7506e2-5b2f-4790-b2ff-201904cfe987 service neutron] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:23.984259 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7506e2-5b2f-4790-b2ff-201904cfe987 service neutron] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:23.989179 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df791d-c2ac-41b0-909e-c034e320d0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:23.989824 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df791d-c2ac-41b0-909e-c034e320d0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:23.990112 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df791d-c2ac-41b0-909e-c034e320d0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:23.990388 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df791d-c2ac-41b0-909e-c034e320d0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:23.999770 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df791d-c2ac-41b0-909e-c034e320d0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:24.001434 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df791d-c2ac-41b0-909e-c034e320d0a2 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:24.010868 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 613/1242] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:23 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:25.804843 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=6 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:27.350405 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97fd29-4f96-4c70-96d1-a2952e8af5e0 service nova] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:53:27.363539 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97fd29-4f96-4c70-96d1-a2952e8af5e0 service nova] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:53:27.374389 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744f73-1b15-49ea-a8a1-dfcd5aca10b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:53:27.375225 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744f73-1b15-49ea-a8a1-dfcd5aca10b9 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:53:27.375518 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744f73-1b15-49ea-a8a1-dfcd5aca10b9 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:53:27.375947 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744f73-1b15-49ea-a8a1-dfcd5aca10b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:53:27.388214 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5744f73-1b15-49ea-a8a1-dfcd5aca10b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:53:27.390119 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5744f73-1b15-49ea-a8a1-dfcd5aca10b9 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:53:27.403940 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 630/1243] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:53:27 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:53:34.006741 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=6 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:53:37.398604 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=6 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:54:36.556675 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810d2b-3267-4c7e-a969-25d18fc33540 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:54:36.557275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810d2b-3267-4c7e-a969-25d18fc33540 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:54:36.557275 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68810d2b-3267-4c7e-a969-25d18fc33540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:54:36.575129 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-68810d2b-3267-4c7e-a969-25d18fc33540 None None] MFA Rules not processed for user `39b53390061840f4bc577c5f507fabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:54:36.576368 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-68810d2b-3267-4c7e-a969-25d18fc33540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:54:36.583329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 614/1244] 10.222.0.26 () {58 vars in 957 bytes} [Sat Jun 25 20:54:36 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:54:46.569967 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=3 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:50.795789 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744f73-1b15-49ea-a8a1-dfcd5aca10b9 service nova] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:50.853286 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744f73-1b15-49ea-a8a1-dfcd5aca10b9 service nova] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:50.866087 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523f7e3-d12f-4c39-bbbc-53560a3bfe36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf16c49c506a4f5c86e3538cd3ed12be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:50.867413 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523f7e3-d12f-4c39-bbbc-53560a3bfe36 service nova] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:50.867846 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523f7e3-d12f-4c39-bbbc-53560a3bfe36 service nova] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:50.868224 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523f7e3-d12f-4c39-bbbc-53560a3bfe36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:50.882215 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523f7e3-d12f-4c39-bbbc-53560a3bfe36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:50.884049 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523f7e3-d12f-4c39-bbbc-53560a3bfe36 service nova] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:50.896620 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 631/1245] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:50 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 25 20:55:52.431152 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68810d2b-3267-4c7e-a969-25d18fc33540 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:52.433521 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-68810d2b-3267-4c7e-a969-25d18fc33540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:52.475181 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68810d2b-3267-4c7e-a969-25d18fc33540 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:52.479804 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b03e0-b3c9-4bd2-a569-e84a01047ed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:52.480462 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b03e0-b3c9-4bd2-a569-e84a01047ed2 service neutron] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:52.480752 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b03e0-b3c9-4bd2-a569-e84a01047ed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:52.481065 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b03e0-b3c9-4bd2-a569-e84a01047ed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:52.581382 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b03e0-b3c9-4bd2-a569-e84a01047ed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:52.582816 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b03e0-b3c9-4bd2-a569-e84a01047ed2 service neutron] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:52.603488 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 615/1246] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:55.955668 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31104369-7d49-45b5-9479-1afdb1b3f50c None None] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:55.956205 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31104369-7d49-45b5-9479-1afdb1b3f50c None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:55.956205 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31104369-7d49-45b5-9479-1afdb1b3f50c None None] PATH_INFO: `/` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:55.957571 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 632/1247] 10.222.0.26 () {54 vars in 921 bytes} [Sat Jun 25 20:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:55:55.968403 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4586da-f761-40dd-bbf8-b0775cc6a591 None None] REQUEST_METHOD: `POST` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:55.969190 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4586da-f761-40dd-bbf8-b0775cc6a591 None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:55.969334 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4586da-f761-40dd-bbf8-b0775cc6a591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:56.050338 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.auth.core [None req-9c4586da-f761-40dd-bbf8-b0775cc6a591 None None] MFA Rules not processed for user `d91c64b1ed4e49c7870ac00844b29bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93694) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:55:56.051680 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-9c4586da-f761-40dd-bbf8-b0775cc6a591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:56.060298 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 616/1248] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Jun 25 20:55:55 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:55:56.072453 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31104369-7d49-45b5-9479-1afdb1b3f50c None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:56.087858 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31104369-7d49-45b5-9479-1afdb1b3f50c None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:56.093460 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81ccd6-4332-45ec-bedd-21f4732a9a21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91c64b1ed4e49c7870ac00844b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:56.094466 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81ccd6-4332-45ec-bedd-21f4732a9a21 service placement] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:56.094933 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81ccd6-4332-45ec-bedd-21f4732a9a21 service placement] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:56.095213 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81ccd6-4332-45ec-bedd-21f4732a9a21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:56.105213 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81ccd6-4332-45ec-bedd-21f4732a9a21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:56.107235 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81ccd6-4332-45ec-bedd-21f4732a9a21 service placement] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:56.117898 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 633/1249] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:55:56 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:55:59.380110 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4586da-f761-40dd-bbf8-b0775cc6a591 None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:59.407694 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4586da-f761-40dd-bbf8-b0775cc6a591 None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:59.413191 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:59.414057 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:59.414923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:59.415206 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] PATH_INFO: `/v3/users/490615605dbf4c4cb609d401ce2e8505` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:59.416525 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490615605dbf4c4cb609d401ce2e8505)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:59.417621 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: WARNING py.warnings [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:55:59.417621 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: warnings.warn(msg) Jun 25 20:55:59.417621 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: Jun 25 20:55:59.422898 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:59.497297 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490615605dbf4c4cb609d401ce2e8505'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.498309 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490615605dbf4c4cb609d401ce2e8505'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.499119 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490615605dbf4c4cb609d401ce2e8505'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.509239 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490615605dbf4c4cb609d401ce2e8505'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.521368 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490615605dbf4c4cb609d401ce2e8505'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.530592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:55:59.554801 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 617/1250] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Jun 25 20:55:59 2022] DELETE /identity/v3/users/490615605dbf4c4cb609d401ce2e8505 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:59.757179 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81ccd6-4332-45ec-bedd-21f4732a9a21 service placement] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:59.769293 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81ccd6-4332-45ec-bedd-21f4732a9a21 service placement] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:55:59.840445 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:55:59.842527 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:55:59.842848 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:55:59.843288 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] PATH_INFO: `/v3/projects/244599ab2d6848fcaf4fda46b932554d` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:55:59.844875 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] RBAC: Authorizing `identity:delete_project(project_id=244599ab2d6848fcaf4fda46b932554d)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:55:59.846020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: WARNING py.warnings [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 25 20:55:59.846020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: warnings.warn(msg) Jun 25 20:55:59.846020 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: Jun 25 20:55:59.847261 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:55:59.906124 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '244599ab2d6848fcaf4fda46b932554d', 'request_id': 'req-d33f2b79-5fa8-419f-a6e5-db588ee3968b'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.915271 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '244599ab2d6848fcaf4fda46b932554d', 'request_id': 'req-d33f2b79-5fa8-419f-a6e5-db588ee3968b'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.925423 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '244599ab2d6848fcaf4fda46b932554d', 'request_id': 'req-d33f2b79-5fa8-419f-a6e5-db588ee3968b'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.963978 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] The token cache is being invalidate because project 244599ab2d6848fcaf4fda46b932554d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:55:59.964356 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.965102 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:55:59.967578 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 634/1251] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Jun 25 20:55:59 2022] DELETE /identity/v3/projects/244599ab2d6848fcaf4fda46b932554d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:55:59.972654 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:55:59.974457 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:55:59.990592 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff973677-de3d-4854-9bd6-658505ab5dc5 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:00.070648 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:00.071545 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:00.071864 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:00.072174 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] PATH_INFO: `/v3/users/19622c4f40d94c5c88d4182a95b92f4b` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:00.073543 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=19622c4f40d94c5c88d4182a95b92f4b)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:00.076032 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:00.130614 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19622c4f40d94c5c88d4182a95b92f4b'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.131377 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19622c4f40d94c5c88d4182a95b92f4b'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.131988 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19622c4f40d94c5c88d4182a95b92f4b'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.141026 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19622c4f40d94c5c88d4182a95b92f4b'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.148019 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19622c4f40d94c5c88d4182a95b92f4b'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.167569 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 618/1252] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Jun 25 20:55:59 2022] DELETE /identity/v3/users/19622c4f40d94c5c88d4182a95b92f4b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:00.357814 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:00.360440 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:00.382517 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f2b79-5fa8-419f-a6e5-db588ee3968b admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:00.408892 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:00.453134 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:00.454512 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:00.454821 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:00.455108 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] PATH_INFO: `/v3/projects/7641bdeff29f4c56aa3d221bbafacc30` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:00.456809 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7641bdeff29f4c56aa3d221bbafacc30)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:00.459785 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:00.510984 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7641bdeff29f4c56aa3d221bbafacc30', 'request_id': 'req-ce040c26-6cf2-44c0-b342-1c76dc6caed5'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.518434 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7641bdeff29f4c56aa3d221bbafacc30', 'request_id': 'req-ce040c26-6cf2-44c0-b342-1c76dc6caed5'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.527861 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7641bdeff29f4c56aa3d221bbafacc30', 'request_id': 'req-ce040c26-6cf2-44c0-b342-1c76dc6caed5'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.539608 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] The token cache is being invalidate because project 7641bdeff29f4c56aa3d221bbafacc30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93695) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:56:00.539912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.540530 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:56:00.542123 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 635/1253] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Jun 25 20:56:00 2022] DELETE /identity/v3/projects/7641bdeff29f4c56aa3d221bbafacc30 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:56:10.163585 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=58,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:10.536760 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:56:41.881134 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:56:41.882738 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:41.961179 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ae616-f4c6-408f-90eb-4130afcb6d3a admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:56:42.026319 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e01356-15b8-4bb1-ab4b-ed4015755bc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91c64b1ed4e49c7870ac00844b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:56:42.027011 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01356-15b8-4bb1-ab4b-ed4015755bc1 service placement] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:56:42.027303 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01356-15b8-4bb1-ab4b-ed4015755bc1 service placement] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:56:42.027589 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e01356-15b8-4bb1-ab4b-ed4015755bc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:56:42.030329 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-a2e01356-15b8-4bb1-ab4b-ed4015755bc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:56:42.041804 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01356-15b8-4bb1-ab4b-ed4015755bc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:56:42.043470 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e01356-15b8-4bb1-ab4b-ed4015755bc1 service placement] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:56:42.054089 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 619/1254] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:56:41 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:56:52.049948 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=58 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:24.464903 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:24.466562 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:24.524656 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce040c26-6cf2-44c0-b342-1c76dc6caed5 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:24.528601 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134571a-d35c-4999-af18-436383947030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ddd2eb988484d7ab0e64323fe4f4602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:24.529253 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134571a-d35c-4999-af18-436383947030 service neutron] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:24.529536 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134571a-d35c-4999-af18-436383947030 service neutron] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:24.529815 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134571a-d35c-4999-af18-436383947030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:24.531747 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-7134571a-d35c-4999-af18-436383947030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:24.595410 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134571a-d35c-4999-af18-436383947030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:24.596871 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134571a-d35c-4999-af18-436383947030 service neutron] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:24.606727 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 636/1255] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:30.938957 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6706eb-0c11-411f-9663-7d5f00d0200d None None] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:30.939468 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6706eb-0c11-411f-9663-7d5f00d0200d None None] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:30.939468 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6706eb-0c11-411f-9663-7d5f00d0200d None None] PATH_INFO: `/` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:30.940846 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 620/1256] 10.222.0.26 () {54 vars in 921 bytes} [Sat Jun 25 20:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 25 20:57:30.947591 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dae8c-e237-48a6-ba55-8f78301ffce5 None None] REQUEST_METHOD: `POST` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:30.948420 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dae8c-e237-48a6-ba55-8f78301ffce5 None None] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:30.948834 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dae8c-e237-48a6-ba55-8f78301ffce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:30.969139 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.auth.core [None req-c96dae8c-e237-48a6-ba55-8f78301ffce5 None None] MFA Rules not processed for user `d91c64b1ed4e49c7870ac00844b29bb4`. Rule list: `[]` (Enabled: `True`). {{(pid=93695) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 25 20:57:30.970707 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-c96dae8c-e237-48a6-ba55-8f78301ffce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:30.981040 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 637/1257] 10.222.0.26 () {58 vars in 1018 bytes} [Sat Jun 25 20:57:30 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 25 20:57:30.993112 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6706eb-0c11-411f-9663-7d5f00d0200d None None] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:30.995023 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-ac6706eb-0c11-411f-9663-7d5f00d0200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:31.010716 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dae8c-e237-48a6-ba55-8f78301ffce5 None None] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:31.012290 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-c96dae8c-e237-48a6-ba55-8f78301ffce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:31.014024 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6706eb-0c11-411f-9663-7d5f00d0200d None None] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:31.020123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baac316-7b17-4ead-8707-65647a24d242 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91c64b1ed4e49c7870ac00844b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:31.020123 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baac316-7b17-4ead-8707-65647a24d242 service placement] REQUEST_METHOD: `GET` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:31.020429 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baac316-7b17-4ead-8707-65647a24d242 service placement] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:31.020671 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baac316-7b17-4ead-8707-65647a24d242 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:31.027094 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dae8c-e237-48a6-ba55-8f78301ffce5 None None] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:31.031014 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baac316-7b17-4ead-8707-65647a24d242 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:31.032649 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baac316-7b17-4ead-8707-65647a24d242 service placement] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:31.033033 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:31.034369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:31.034369 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:31.034584 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] PATH_INFO: `/v3/users/39b53390061840f4bc577c5f507fabc1` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:31.043397 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 621/1258] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 20:57:30 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 25 20:57:31.050616 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b53390061840f4bc577c5f507fabc1)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:31.052658 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:31.102912 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b53390061840f4bc577c5f507fabc1'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.115076 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b53390061840f4bc577c5f507fabc1'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.115777 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b53390061840f4bc577c5f507fabc1'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.125050 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b53390061840f4bc577c5f507fabc1'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.125840 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b53390061840f4bc577c5f507fabc1'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.140251 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 638/1259] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Jun 25 20:57:31 2022] DELETE /identity/v3/users/39b53390061840f4bc577c5f507fabc1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 25 20:57:31.341512 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baac316-7b17-4ead-8707-65647a24d242 service placement] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:31.355353 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baac316-7b17-4ead-8707-65647a24d242 service placement] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:31.421194 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:31.422226 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:31.422594 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:31.422945 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] PATH_INFO: `/v3/projects/f78e759b32fe4fd6b4cd42757069824f` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:31.434336 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78e759b32fe4fd6b4cd42757069824f)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:31.436593 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:31.488021 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78e759b32fe4fd6b4cd42757069824f', 'request_id': 'req-93649a3c-2337-4dc7-801a-71316dc6df10'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.494064 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78e759b32fe4fd6b4cd42757069824f', 'request_id': 'req-93649a3c-2337-4dc7-801a-71316dc6df10'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.503234 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78e759b32fe4fd6b4cd42757069824f', 'request_id': 'req-93649a3c-2337-4dc7-801a-71316dc6df10'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.518759 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] The token cache is being invalidate because project f78e759b32fe4fd6b4cd42757069824f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:57:31.519050 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.519777 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.521507 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 622/1260] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:31 2022] DELETE /identity/v3/projects/f78e759b32fe4fd6b4cd42757069824f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:31.525761 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:31.527383 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:31.538170 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:31.542255 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b907c0-a5a3-42dd-8d4b-f4222f4971f4 admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:31.600690 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:31.601561 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:31.601866 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:31.602144 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] PATH_INFO: `/v3/users/4a74ba2694954362be2fc80547b5727d` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:31.617163 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a74ba2694954362be2fc80547b5727d)` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:31.619189 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:31.670306 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a74ba2694954362be2fc80547b5727d'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.681956 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a74ba2694954362be2fc80547b5727d'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.682647 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a74ba2694954362be2fc80547b5727d'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.691970 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a74ba2694954362be2fc80547b5727d'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.692642 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.notifications [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a74ba2694954362be2fc80547b5727d'} {{(pid=93695) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:31.706844 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 639/1261] 10.222.0.26 () {58 vars in 1223 bytes} [Sat Jun 25 20:57:31 2022] DELETE /identity/v3/users/4a74ba2694954362be2fc80547b5727d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:31.892769 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] Authenticating user token {{(pid=93694) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 20:57:31.894373 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.fernet_utils [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93694) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 20:57:31.908012 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93649a3c-2337-4dc7-801a-71316dc6df10 admin admin] Validating token access rules against request {{(pid=93694) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 20:57:31.968386 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c76b07e47a84c48b4608f75eeee3a3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a86de01022c4cb490a16df9dbe16261', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93694) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 20:57:31.969250 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 20:57:31.969534 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] SCRIPT_NAME: `/identity` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 20:57:31.969807 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] PATH_INFO: `/v3/projects/6d233b6ef49942f29b46fc60534f3f1d` {{(pid=93694) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 20:57:31.980921 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d233b6ef49942f29b46fc60534f3f1d)` {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 20:57:31.983043 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] RBAC: Authorization granted {{(pid=93694) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 20:57:31.984599 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:32.034287 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d233b6ef49942f29b46fc60534f3f1d', 'request_id': 'req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:32.041113 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d233b6ef49942f29b46fc60534f3f1d', 'request_id': 'req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:32.051482 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d233b6ef49942f29b46fc60534f3f1d', 'request_id': 'req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478'} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:32.063924 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] The token cache is being invalidate because project 6d233b6ef49942f29b46fc60534f3f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93694) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 25 20:57:32.064217 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:32.064923 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG keystone.notifications [None req-ebf8ac3a-8704-4312-ab37-8c2a7de9e478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93694) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 25 20:57:32.066631 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: [pid: 93694|app: 0|req: 623/1262] 10.222.0.26 () {58 vars in 1232 bytes} [Sat Jun 25 20:57:31 2022] DELETE /identity/v3/projects/6d233b6ef49942f29b46fc60534f3f1d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 25 20:57:41.703142 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG dbcounter [-] [93695] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93695) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 20:57:42.060578 dv-osbrick-master-4-ceph devstack@keystone.service[93694]: DEBUG dbcounter [-] [93694] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93694) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 21:01:46.878687 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] Authenticating user token {{(pid=93695) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 25 21:01:46.880444 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:46.965791 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca92b18-4a25-48c2-9c1f-0820802fda7a admin admin] Validating token access rules against request {{(pid=93695) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 25 21:01:47.027106 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed1b4d-cf9c-40c5-b20d-587e85c6ccd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91c64b1ed4e49c7870ac00844b29bb4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad8cd680e7d47a7a966e6f82e56ec87', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93695) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 25 21:01:47.027773 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1b4d-cf9c-40c5-b20d-587e85c6ccd0 service placement] REQUEST_METHOD: `GET` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 25 21:01:47.028064 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1b4d-cf9c-40c5-b20d-587e85c6ccd0 service placement] SCRIPT_NAME: `/identity` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 25 21:01:47.028347 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1b4d-cf9c-40c5-b20d-587e85c6ccd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93695) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 25 21:01:47.030371 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.fernet_utils [None req-e3ed1b4d-cf9c-40c5-b20d-587e85c6ccd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93695) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 25 21:01:47.041980 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed1b4d-cf9c-40c5-b20d-587e85c6ccd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 25 21:01:47.043629 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed1b4d-cf9c-40c5-b20d-587e85c6ccd0 service placement] RBAC: Authorization granted {{(pid=93695) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 25 21:01:47.053245 dv-osbrick-master-4-ceph devstack@keystone.service[93695]: [pid: 93695|app: 0|req: 640/1263] 10.222.0.26 () {60 vars in 1365 bytes} [Sat Jun 25 21:01:46 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)